-- Logs begin at Fri 2022-08-05 14:36:10 UTC, end at Fri 2022-08-05 15:49:33 UTC. -- Aug 05 15:22:02.606410 dv-cinder-849890-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 15:22:02.615194 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 15:22:02 2022] *** Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: nodename: dv-cinder-849890-4-iscsi Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: machine: x86_64 Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: clock source: unix Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: pcre jit disabled Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: detected number of CPU cores: 4 Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: current working directory: / Aug 05 15:22:02.617233 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: detected binary path: /usr/bin/uwsgi-core Aug 05 15:22:02.617983 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: your processes number limit is 47680 Aug 05 15:22:02.617983 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: your memory page size is 4096 bytes Aug 05 15:22:02.617983 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: detected max file descriptor number: 2048 Aug 05 15:22:02.617983 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: lock engine: pthread robust mutexes Aug 05 15:22:02.617983 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: thunder lock: enabled Aug 05 15:22:02.617983 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 15:22:02.617983 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 15:22:02.657013 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: Python main interpreter initialized at 0x56171a4d29c0 Aug 05 15:22:02.657013 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: python threads support enabled Aug 05 15:22:02.657013 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: your server socket listen backlog is limited to 100 connections Aug 05 15:22:02.657013 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: your mercy for graceful operations on workers is 90 seconds Aug 05 15:22:02.657354 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 15:22:02.657429 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: *** Operational MODE: preforking *** Aug 05 15:22:02.657669 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: *** uWSGI is running in multiple interpreter mode *** Aug 05 15:22:02.657669 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: spawned uWSGI master process (pid: 103763) Aug 05 15:22:02.657864 dv-cinder-849890-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 15:22:02.658913 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: spawned uWSGI worker 1 (pid: 103764, cores: 1) Aug 05 15:22:02.658913 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: spawned uWSGI worker 2 (pid: 103765, cores: 1) Aug 05 15:22:02.658913 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 15:22:03.309617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 15:22:03.320132 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 15:22:04.385053 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 15:22:04.385053 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: from cryptography.utils import int_from_bytes Aug 05 15:22:04.385669 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 15:22:04.385669 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: from cryptography.utils import int_from_bytes Aug 05 15:22:04.385789 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 15:22:04.385789 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: from cryptography.utils import int_from_bytes Aug 05 15:22:04.386183 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 15:22:04.386183 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: from cryptography.utils import int_from_bytes Aug 05 15:22:06.876507 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 15:22:06.877076 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 15:22:06.877529 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 15:22:06.877887 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 15:22:06.878143 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 15:22:06.878535 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.878858 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.879174 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.879490 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.879823 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.880153 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.880474 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.880790 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.881115 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.881374 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.881585 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 15:22:06.881965 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.882047 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 15:22:06.882137 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-4-iscsi {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.882300 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.882392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 15:22:06.882606 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.882698 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 15:22:06.882914 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.883000 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 15:22:06.883231 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.883317 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.883534 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.883626 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.883854 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.883939 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.884183 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.884272 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.884606 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.884702 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.884918 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.885102 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.885240 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.885433 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.885555 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.885725 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.885871 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.886062 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.886190 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.886374 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.886510 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.886684 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.886775 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-4-iscsi {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.887553 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.887693 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.887868 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.887981 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.888235 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.888336 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.888525 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.888658 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.888831 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.888924 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-4-iscsi {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.889154 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.889282 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.889461 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.889557 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.889825 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.889964 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.890233 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.890368 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.890546 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.890634 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.890853 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.890939 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.891173 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.891258 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.891485 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.891570 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.891793 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.891879 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.892120 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.892244 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.892436 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.892537 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.892761 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.892862 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.893055 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.893143 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.893369 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.893462 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-4-iscsi {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.893678 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.893774 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.893987 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.894074 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.894305 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.894398 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.894610 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.894746 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.894914 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.895060 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.895166 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.895370 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.895463 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.895695 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.895794 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.896022 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.896134 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.896358 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.896446 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.896671 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.896800 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.896904 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.896997 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.897227 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.897313 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.897545 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.897631 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.897852 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.897940 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.898159 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.898266 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.898459 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.898562 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.898759 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.898865 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.899061 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.899148 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.899365 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.899460 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.899617 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.899708 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.899927 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.900013 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.900275 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.900373 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.900597 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.900683 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.900917 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.901002 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.901172 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.901272 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.901423 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.901509 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.901744 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.901902 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.902067 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.902162 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.902397 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.902487 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.902708 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.902793 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.903016 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.903109 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.903323 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.903416 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.903631 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.903716 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.903936 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.904029 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.904267 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.904354 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.904576 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.904661 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.904896 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.904983 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.905211 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.905303 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.905535 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.905626 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.905837 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.905922 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.906086 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.906171 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.906385 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.906536 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.906687 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.906774 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.907003 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.907088 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.907306 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.907401 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.907609 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.907719 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.907912 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.908030 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.908233 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.908375 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.908522 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.908699 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.908827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.909010 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.909131 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.909317 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.909433 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.909623 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.909741 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.909942 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.910038 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.910281 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.910368 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.910589 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.910687 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.910840 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.910934 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.911145 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.911232 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.911449 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.911534 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.911768 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.911861 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.912100 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.912188 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.912402 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.912497 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.912705 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.912814 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.913006 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.913107 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.913311 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.913398 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.913611 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.913709 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.913914 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.913999 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.914220 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.914304 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.914518 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.914610 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.914821 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.914913 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.915125 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.915212 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.915428 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.915527 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.915731 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.915816 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.916027 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.916159 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.916353 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.916449 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.916667 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.916759 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.916970 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.917055 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.917270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.917363 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.917572 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.917672 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.917876 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.917962 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.918207 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.918301 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.918508 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.918592 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.918810 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.918896 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.919111 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.919201 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.919408 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.919501 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.919724 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.919815 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.920033 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.920194 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.920361 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.920447 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.920663 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.920758 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.920968 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.921054 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.921276 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.921361 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.921595 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.921686 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.921901 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.921988 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.922208 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.922295 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.922512 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.922614 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.922815 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.922907 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.923119 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.923205 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.923425 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.923522 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.923729 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.923826 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.924032 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.924158 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.924354 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.924453 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.924673 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.924760 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.924995 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.925116 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.925306 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.925399 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.925613 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.925706 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.925920 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.926007 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.926241 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:22:06.926328 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.926555 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.926640 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.926870 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.926962 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.927188 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.927276 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.927499 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.927591 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.927814 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.927901 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.928165 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.928256 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.928488 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.928597 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.928800 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.928889 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.929113 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.929199 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.929443 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.929539 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.929760 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.929846 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.930078 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.930165 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.930395 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.930490 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.930705 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.930806 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.931016 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.931102 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.931325 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.931410 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.931647 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.931741 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.931964 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.932055 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.932298 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.932383 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.932609 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.932706 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.932917 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.933002 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.933227 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.933313 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.933537 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.934177 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.934364 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.934454 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.934676 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.934770 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.935011 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.935105 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.935329 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.935418 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.935644 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.935737 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.935955 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.936042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.936290 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.936388 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.936598 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.936684 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.936908 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.936993 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.937214 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.937299 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.937518 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.937612 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.937822 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.937909 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.938126 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.938220 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.938435 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.938521 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.938737 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.938858 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.939050 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.939135 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.939368 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.939496 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.939668 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.939767 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.940000 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.940112 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.940333 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.940441 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.940645 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.940741 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.940956 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.941060 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.941268 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.941375 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.941572 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.941667 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.941880 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.941981 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.942189 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.942294 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.942492 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.942584 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.942796 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.942890 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.943105 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.943208 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.943406 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.943499 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.943709 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.943809 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.944018 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.944143 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.944348 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.944444 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.944660 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.944753 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.944968 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.945062 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.945278 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.945381 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.945587 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.945675 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.945896 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.945989 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.946207 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.946294 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.946514 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.946612 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.946825 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.946911 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.947135 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.947223 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.947442 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.947536 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.947758 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.947843 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.948100 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.948189 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.948399 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.948498 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.948716 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.948817 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.949021 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.949168 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.949861 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.950010 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.950178 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.950309 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.950484 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.950626 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.950836 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.950978 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.951117 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.951258 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.951407 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.951541 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.951680 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.951828 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.951960 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.952112 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.952264 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.952408 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.952556 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.952689 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.952876 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.953011 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.953187 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.953337 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.953477 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.953619 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.953779 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.953911 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.954069 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.954168 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.954412 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.954499 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.954716 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.954802 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.955058 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.955157 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.955360 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.955452 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.955664 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.955759 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.955973 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.956099 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.956301 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.956388 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.956606 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.956692 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.956911 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.957006 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.957215 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.957307 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.957520 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.957606 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.957826 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.957912 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.958144 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.958228 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.958449 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.958535 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.958753 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.958846 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.959057 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.959142 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.959377 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.959462 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.959687 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.959786 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.960005 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.960129 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.960336 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.960434 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.960653 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.960740 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.960983 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.961074 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.961297 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.961390 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.961613 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.961699 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.961927 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.962021 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.962234 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.962450 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.962551 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.962631 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.962838 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.962925 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.963143 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.963237 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.963451 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.963538 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.963763 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.963856 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.964097 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.964238 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.964398 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.964492 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.964709 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.964795 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.965041 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.965137 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.965346 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.965438 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.965653 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.965748 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.965968 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.966062 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.966268 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.966354 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.966581 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.966667 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.966907 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.966994 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.967220 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.967305 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.967532 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.967616 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.967842 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.967929 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.968173 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.968262 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.968486 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.968574 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.968791 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.968877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.969103 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.969189 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.969408 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.969503 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.969715 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.969800 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.970021 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.970145 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.970333 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.970426 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.970640 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.970725 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.970945 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.971043 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.971245 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.971342 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.971555 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.971642 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.971858 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.971944 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.972194 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.972299 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.972500 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.972592 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.972809 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.972895 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.973130 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.973217 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.973439 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.973532 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.973751 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.973836 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.974066 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.974153 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.974364 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.974457 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.974666 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.974773 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.974976 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.975069 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.975281 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.975365 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.975583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.975676 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.975886 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.975974 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.976210 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.976299 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.976525 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.976610 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.976836 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.976923 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.977139 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.977230 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.977440 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.977535 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.977757 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.977849 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.978061 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.978146 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.978374 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.978467 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.978685 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.978772 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.978994 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.979088 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.979296 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.979476 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.979602 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.979689 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.979908 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.979993 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.980247 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.980346 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.980578 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.980669 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.980885 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.980970 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.981190 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.981284 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.981508 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.981593 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.981818 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.981904 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.982121 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.982206 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.982425 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.982510 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.982729 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.982821 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.983037 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.983125 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.983349 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.983433 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.983661 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.983914 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.984009 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.984273 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.984369 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.984587 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.984685 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.984902 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.984988 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.985212 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.985298 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.985523 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.985617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.985834 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.985925 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.986145 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.986231 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.986468 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.986560 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.986773 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.986874 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.987082 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.987177 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.987385 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.987477 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.987689 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.987783 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.987998 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.988134 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.988327 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.988412 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.988636 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.988890 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.988978 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.989229 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.989315 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.989531 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.989637 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.989832 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.989920 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.990141 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.990229 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.990446 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.990544 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.990760 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.990846 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.991062 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.991155 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.991373 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.991472 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.991675 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.991770 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.991999 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.992107 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.992331 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.992421 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.992631 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.992717 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.992934 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.993027 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.993235 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.993323 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.993541 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.993626 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.993847 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.993951 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.994159 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.994241 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.994464 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.994558 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.994769 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.994855 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.995074 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.995168 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.995380 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.995466 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.995697 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.995782 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.996002 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.996692 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.996852 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.996984 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.997158 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.997287 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.997470 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.997610 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.997795 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.997891 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.998068 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.998153 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.998377 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.998470 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.998680 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.998788 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.998989 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.999082 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.999299 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.999399 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.999602 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.999711 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:06.999906 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.000005 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.000234 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.000323 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.000553 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.000642 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.000860 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.000947 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.001164 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.001259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.001466 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.001558 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.001778 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.001872 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.002078 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.002162 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.002632 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.002717 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.002939 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.003036 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.003239 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.003324 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.003547 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.003631 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.003849 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.004007 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.004175 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.004275 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.004479 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.004568 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.004778 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.004871 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.005082 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.005167 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.005383 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.005468 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.005698 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.005793 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.006005 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.006098 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.006303 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.006473 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.006605 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.006699 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.006913 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.006999 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.007212 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.007296 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.007512 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.007604 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.007818 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.007904 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.008143 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.008232 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.008460 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.008548 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.008760 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.008844 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.009064 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.009150 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.009362 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.009456 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.009669 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.009765 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.009970 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.010066 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.010272 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.010356 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.010575 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.010668 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.010876 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.010970 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.011177 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.011263 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.011477 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.011563 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.012383 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.012723 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.012820 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.013033 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.013119 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.013337 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.013422 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.013644 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.013731 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.013945 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.014031 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.014289 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.014383 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.014596 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.014684 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.014908 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.015000 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.015216 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.015310 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.015523 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.015609 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.015829 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.015915 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.016165 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.016282 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.016469 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.016563 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.016774 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.016860 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.017074 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.017172 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.017376 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.017462 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.017681 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.017768 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.017989 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.018075 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.018292 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.018378 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.018594 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.018683 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.018901 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.018989 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.019208 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.019300 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.019518 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.019605 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.019841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.019935 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.020185 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.020277 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.020567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.020666 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.020811 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.020900 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.021121 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.021206 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.021428 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.021526 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.021735 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.021823 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.022043 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.022128 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.022344 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.022436 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.022650 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.022735 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.022960 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.023054 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.023268 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.023362 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.023572 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.023656 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.023877 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.023963 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.024206 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.024306 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.024517 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.024650 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.024826 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.024919 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.025126 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.025212 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.025450 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.025536 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.025760 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.025846 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.026064 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.026187 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.026371 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.026459 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.026670 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.026757 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.026978 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.027065 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.027279 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.027382 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.027612 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.027729 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.027925 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.028042 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.028262 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.028450 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.028574 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.028755 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.028886 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.029064 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.029205 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.029372 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.029513 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.029687 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.029822 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.030000 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.030124 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.030302 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.030430 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.030724 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.030823 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.031034 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.031122 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.031341 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.031434 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.031649 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.031735 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.031949 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.032034 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.032277 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.032379 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.032584 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.032671 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.032905 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.033059 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.033209 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.033371 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.033511 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.033669 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.033812 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.033974 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.034134 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.034284 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.034437 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.034593 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.034756 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.034909 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.035171 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.035268 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.035482 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.035569 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.035783 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.035919 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.036220 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.036312 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.036534 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.036620 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.036843 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.036941 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.037155 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.037248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.037460 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.037546 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.037770 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.037856 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.038069 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.038154 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.038383 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.038471 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.038683 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.038769 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.038988 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.039075 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.039316 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.039403 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.039621 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.039719 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.039933 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.040017 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.040273 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.040427 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.040601 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.040733 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.040924 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.041022 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.041238 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.041374 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.041560 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.041689 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.041971 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.042065 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.042292 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.042379 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.042602 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.042696 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.042922 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.043039 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.043251 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.043336 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.043564 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.043650 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.043867 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.044027 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.044200 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.044323 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.044502 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.044589 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.044808 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.044896 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.045129 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.045222 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.045434 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.045533 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.045742 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.045828 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.046050 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.046137 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.046357 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.046451 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.046661 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.046755 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.046961 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.047099 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.047283 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.047399 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.047585 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.047714 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.047908 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.048037 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.048247 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.048385 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.048570 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.048691 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.048894 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.048982 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.049199 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.049293 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.049523 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.049608 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.049832 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.049918 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.050135 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.050238 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.050436 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.050523 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.050743 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.050829 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.051075 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.051177 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.051373 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.051460 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.051677 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.051763 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.051981 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.052118 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.052328 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.052415 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.052633 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.052721 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.052957 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.053045 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.053273 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.053360 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.053597 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.053690 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.053927 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.054015 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.054238 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.054324 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.054541 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.054625 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.054844 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.054931 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.055148 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.055233 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.055445 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.055538 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.055748 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.055833 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.056045 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.056158 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.056372 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.056505 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.056673 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.056768 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.056973 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.057059 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.057274 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.057373 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.057593 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.057680 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.057894 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.057980 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.058216 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.058310 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.058524 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.059119 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.059436 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.059528 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.059648 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.059742 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.059949 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.060035 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.060369 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.060476 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.060671 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.060759 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.060972 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.061057 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.061279 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.061372 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.061583 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.061679 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.061892 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.061979 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.062193 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.062280 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.062498 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.062586 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.062802 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.062888 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.063111 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.063204 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.063413 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.063498 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.063722 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.063819 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.064032 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.064154 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.064360 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.064448 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.064669 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.064763 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.064972 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.065067 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.065316 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.065488 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.065620 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.065816 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.065947 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.066130 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.066258 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.066444 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.066617 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.066758 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.066902 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.067068 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.067220 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.067389 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.067541 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.067964 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.068133 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.068220 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.068300 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.068379 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.068493 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.068609 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.068810 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.068935 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.069121 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.069254 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.069438 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.069580 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.069758 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.069915 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.070076 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.070260 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.070544 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.070644 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.070859 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.070947 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.071177 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.071270 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.071516 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.071610 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.071828 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.071915 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.072156 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.072247 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.072471 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.072560 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.072780 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.072872 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.073092 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.073185 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.073401 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.073490 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.073709 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.073795 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.074021 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.074116 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.074867 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.074980 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.075173 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.075272 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.075479 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.075576 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.075789 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.075884 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.076119 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.076221 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.076449 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.076549 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.076777 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.076878 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.077093 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.077179 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.077405 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.077501 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.077716 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.077810 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.078029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.078114 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.078343 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.078547 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.078642 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.078866 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.078954 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.079199 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.079295 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.079526 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.079613 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.079852 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.079945 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.080190 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.080296 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.080502 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.080587 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.080817 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.080904 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.081128 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.081261 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.081433 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.081520 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.081744 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.081832 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.082053 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.082142 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.082355 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.082443 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.082676 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.082763 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.082988 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.083076 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.083290 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.083505 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.083592 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.083822 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.083909 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.084182 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.084443 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.084531 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.084785 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.084880 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.085102 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.085225 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.085427 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.085514 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.085751 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.085845 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.086058 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.086144 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.086361 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.086454 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.086671 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.086761 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.086975 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.087060 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.087275 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.087410 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.087587 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.087675 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.087896 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.087981 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.088221 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.088313 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.088523 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.088623 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.088833 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.088926 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.089141 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.089362 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.089457 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.089722 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.089809 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.090050 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.090171 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.090373 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.090504 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.090678 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.090834 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.090985 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.091155 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.091288 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.091468 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.091597 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.091796 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.091882 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.092129 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.092235 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.092443 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.092536 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.092762 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.092847 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.093075 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.093173 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.093377 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.093463 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.093682 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.093768 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.093985 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.094083 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.094293 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.094384 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.094594 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.094679 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.094903 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.094989 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.095201 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.095330 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.095522 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.095609 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.095826 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.095912 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.096160 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.096252 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.096466 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.096552 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.096778 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.096901 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.097082 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.097178 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.097385 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.097471 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.097689 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.097776 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.097991 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.098077 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.098303 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.098402 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.098605 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.098856 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.098942 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.099191 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.099289 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.099506 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.099599 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.099816 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.099904 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.100161 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.100250 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.100470 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.100558 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.100775 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.100860 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.101087 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.101175 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.101414 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.101501 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.101726 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.101813 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.102037 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.102138 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.102345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.102431 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.102658 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.102743 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.102965 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.103123 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.103275 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.103361 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.103588 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.103675 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.103898 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.104170 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.104261 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.104511 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.104597 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.104822 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.104919 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.105131 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.105218 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.105439 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.105553 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.105770 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.105865 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.106085 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.106172 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.106390 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.106484 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.106720 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.106814 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.107035 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.107120 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.107346 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.107431 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.107661 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.107760 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.107967 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.108080 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.108302 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.108388 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.108608 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.108695 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.108916 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.109002 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.109226 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.109311 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.109541 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.109629 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.109852 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.109939 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.110154 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.110241 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.110463 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.110560 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.110773 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.110876 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.111084 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.111184 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.111399 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.111484 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.111741 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.111842 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.112060 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.112182 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.112401 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.112495 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.112715 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.112801 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.113033 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.113127 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.113340 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.113425 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.113650 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.113741 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.113963 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.114058 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.114275 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.114361 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.114592 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.114684 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.114909 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.114996 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.115212 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.115300 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.115515 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.115621 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.115819 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.115929 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.116157 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.116273 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.116469 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.116595 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.116774 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.116916 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.117076 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.117230 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.117385 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.117554 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.117688 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.117880 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.117992 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.118193 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.118279 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.118514 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.118610 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.118826 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.118914 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.119158 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.119245 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.119456 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.119555 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.119758 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.119891 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.120074 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.120175 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.120385 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.120473 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.120689 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.120783 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.121002 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.121595 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.121817 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.121907 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.122125 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.122220 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.122428 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.122527 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.122732 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.122819 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.123034 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.123119 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.123349 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.123438 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.123653 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.123747 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.123960 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.124059 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.124326 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.124415 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.124638 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.124724 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.124946 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.125032 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.125249 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.125336 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.125556 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.125666 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.125858 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.125966 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.126162 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.126253 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.126466 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.126596 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.126770 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.126868 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.127080 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.127431 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.127636 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.127790 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.127928 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.128110 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.128243 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.128385 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.128545 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.128681 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.128848 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.128992 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.129174 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.129308 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.129502 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.129639 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.129809 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.129957 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.130135 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.130271 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.130443 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.130577 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.130760 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.130895 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.131068 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.131203 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.131376 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.131510 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.131701 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.131833 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.132010 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.132116 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.132343 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.132430 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.132653 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.132742 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.132963 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.133050 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.133273 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.133366 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.133595 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.133726 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.133895 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.133982 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.134202 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.134296 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.134513 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.134606 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.134828 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.134915 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.135153 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.135246 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.135458 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.135545 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.135776 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.135873 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.136111 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.136201 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.136430 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.136519 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.136784 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.137384 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.137605 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.137703 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.137934 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.138023 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.138285 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.138381 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.138562 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.138651 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.138873 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.138959 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.139185 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.139272 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.139427 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 15:22:07.139515 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.139796 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.140134 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.140449 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.140768 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.141085 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.141414 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.141741 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.142054 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.142384 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.142715 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.143067 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.143382 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.143729 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.144060 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.144397 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.144713 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.145022 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:22:07.145266 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 15:22:07.292545 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO dbcounter [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Registered counter for database nova_api Aug 05 15:22:07.298359 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO dbcounter [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Registered counter for database nova_api Aug 05 15:22:07.314399 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_db.sqlalchemy.engines [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:22:07.319968 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_db.sqlalchemy.engines [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:22:07.321291 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writer thread running {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:22:07.326441 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writer thread running {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:22:07.376385 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.context [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2afb463e-7116-427f-86ac-1e9017fa5c96(cell1) {{(pid=103765) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 15:22:07.380523 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:22:07.380938 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:22:07.381978 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.context [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2afb463e-7116-427f-86ac-1e9017fa5c96(cell1) {{(pid=103764) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 15:22:07.382517 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:22:07.383238 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:22:07.383680 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:22:07.385656 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:22:07.385800 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_concurrency.lockutils [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:22:07.386281 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_concurrency.lockutils [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:22:07.387638 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO dbcounter [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Registered counter for database nova_cell0 Aug 05 15:22:07.387880 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_concurrency.lockutils [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:22:07.388643 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_concurrency.lockutils [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:22:07.389094 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_concurrency.lockutils [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:22:07.391084 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_concurrency.lockutils [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:22:07.392962 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO dbcounter [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Registered counter for database nova_cell1 Aug 05 15:22:07.393110 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO dbcounter [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Registered counter for database nova_cell0 Aug 05 15:22:07.398476 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO dbcounter [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Registered counter for database nova_cell1 Aug 05 15:22:07.400666 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_db.sqlalchemy.engines [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:22:07.402545 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_db.sqlalchemy.engines [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:22:07.405927 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_db.sqlalchemy.engines [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:22:07.407136 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_db.sqlalchemy.engines [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:22:07.407785 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writer thread running {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:22:07.413811 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writer thread running {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:22:07.416084 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writer thread running {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:22:07.542067 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writer thread running {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:22:07.552411 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO dbcounter [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Registered counter for database nova_cell0 Aug 05 15:22:07.561758 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_db.sqlalchemy.engines [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:22:07.565234 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO dbcounter [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Registered counter for database nova_cell0 Aug 05 15:22:07.566549 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writer thread running {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:22:07.574152 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG oslo_db.sqlalchemy.engines [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:22:07.578520 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writer thread running {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:22:07.957006 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: WARNING keystonemiddleware.auth_token [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 15:22:07.964341 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: WARNING keystonemiddleware.auth_token [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 15:22:07.984596 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: WARNING keystonemiddleware.auth_token [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 15:22:07.991707 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: WARNING keystonemiddleware.auth_token [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 15:22:08.304488 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: WARNING keystonemiddleware.auth_token [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 15:22:08.310414 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: WARNING keystonemiddleware.auth_token [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 15:22:08.315591 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56171a4d29c0 pid: 103765 (default app) Aug 05 15:22:08.317674 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:22:08.318831 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 Aug 05 15:22:08.319246 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Fri Aug 5 15:22:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:22:08.331374 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: WARNING keystonemiddleware.auth_token [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 15:22:08.337307 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: WARNING keystonemiddleware.auth_token [None req-94ede387-086b-4486-901b-7119cdc6ca42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 15:22:08.343081 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56171a4d29c0 pid: 103764 (default app) Aug 05 15:23:26.830229 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:26.831901 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002402 Aug 05 15:23:26.832678 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:26.845666 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writing DB stats nova_api:SELECT=3 {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:26.846563 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writing DB stats nova_cell0:SELECT=3 {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:26.847579 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writing DB stats nova_cell1:SELECT=3 {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:26.848620 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:27.723333 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-7be4611a-cab3-495e-8c76-4c8a5453cdd1 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:27.756555 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-7be4611a-cab3-495e-8c76-4c8a5453cdd1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916039 Aug 05 15:23:27.757799 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 5 15:23:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:29.957528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:29.958544 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-fd3cac4b-7956-432d-8105-eb5d8b3269fa None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 05 15:23:29.959209 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:30.437788 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-33f523e2-d87d-47ce-833a-ba14e4850d16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "disk": 1}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:30.457808 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 15:23:30.457808 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: warnings.warn(msg) Aug 05 15:23:30.537762 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-33f523e2-d87d-47ce-833a-ba14e4850d16 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.572476 Aug 05 15:23:30.538681 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:23:30.552781 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_api:SELECT=3 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:30.553967 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_cell1:SELECT=3 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:30.555005 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_cell0:SELECT=3 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:30.555739 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:30.773983 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-7e481923-8ee7-4e0e-bbf2-0b983755ee8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:30.778835 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 15:23:30.778835 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: warnings.warn(msg) Aug 05 15:23:30.931088 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-7e481923-8ee7-4e0e-bbf2-0b983755ee8e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.384036 Aug 05 15:23:30.931738 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 15:23:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:33.149114 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-33f523e2-d87d-47ce-833a-ba14e4850d16 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:33.150135 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-33f523e2-d87d-47ce-833a-ba14e4850d16 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 05 15:23:33.150705 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:33.821257 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-a0c999f0-34bc-4c16-9fc9-a2c8b0db12d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:33.840664 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 15:23:33.840664 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: warnings.warn(msg) Aug 05 15:23:33.935109 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-a0c999f0-34bc-4c16-9fc9-a2c8b0db12d5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777834 Aug 05 15:23:33.936783 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:23:33.948614 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-372dc96b-e652-4e0a-b097-a321126ed618 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:33.952292 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 15:23:33.952292 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: warnings.warn(msg) Aug 05 15:23:34.050377 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-372dc96b-e652-4e0a-b097-a321126ed618 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105413 Aug 05 15:23:34.051217 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 15:23:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:36.289954 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-a0c999f0-34bc-4c16-9fc9-a2c8b0db12d5 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:36.290972 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-a0c999f0-34bc-4c16-9fc9-a2c8b0db12d5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 05 15:23:36.291377 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:36.682467 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ad91b130-323c-4cb9-bb89-b7dc9e939c02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "id": "d2", "ram": 1024}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:36.764358 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ad91b130-323c-4cb9-bb89-b7dc9e939c02 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467193 Aug 05 15:23:36.765052 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:23:36.777906 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-8850f4b7-5098-4f86-9170-a21b00918259 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:36.865438 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-8850f4b7-5098-4f86-9170-a21b00918259 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091734 Aug 05 15:23:36.866151 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 15:23:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:39.065475 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ad91b130-323c-4cb9-bb89-b7dc9e939c02 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:39.066569 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ad91b130-323c-4cb9-bb89-b7dc9e939c02 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 05 15:23:39.067076 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:39.539837 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-0547a04a-5d83-4655-90b0-22727c3aae34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "name": "ds2G", "swap": 0, "ram": 2048}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:39.623472 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-0547a04a-5d83-4655-90b0-22727c3aae34 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.550186 Aug 05 15:23:39.624283 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:23:39.638917 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-180ebefe-a224-4acf-a3db-55e11725e4d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:39.721154 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-180ebefe-a224-4acf-a3db-55e11725e4d3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085990 Aug 05 15:23:39.721727 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 15:23:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:41.921379 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-0547a04a-5d83-4655-90b0-22727c3aae34 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:41.922965 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-0547a04a-5d83-4655-90b0-22727c3aae34 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Aug 05 15:23:41.934502 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:42.375391 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-73497d2a-fa8b-4ff2-a5b1-a043f79c33b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G"}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:42.523334 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-73497d2a-fa8b-4ff2-a5b1-a043f79c33b1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.593004 Aug 05 15:23:42.530095 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:23:42.536279 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-7223b42d-0e61-4607-ba73-64db2f5a4df6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:42.636034 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-7223b42d-0e61-4607-ba73-64db2f5a4df6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103633 Aug 05 15:23:42.636740 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 15:23:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:44.860136 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-73497d2a-fa8b-4ff2-a5b1-a043f79c33b1 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:44.861278 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-73497d2a-fa8b-4ff2-a5b1-a043f79c33b1 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 05 15:23:44.861573 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:45.274872 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-c2f422f9-a0d8-47c8-b972-75f9d771ee43 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:45.298930 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-c2f422f9-a0d8-47c8-b972-75f9d771ee43 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.430868 Aug 05 15:23:45.299467 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 5 15:23:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:23:47.476760 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-73497d2a-fa8b-4ff2-a5b1-a043f79c33b1 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:47.478207 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-73497d2a-fa8b-4ff2-a5b1-a043f79c33b1 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Aug 05 15:23:47.479215 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:47.940934 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-2f7c5182-f5cc-4403-95ac-33c0067fb1d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:48.024809 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-2f7c5182-f5cc-4403-95ac-33c0067fb1d3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.538973 Aug 05 15:23:48.025487 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:23:48.039171 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-f5628e36-d5e2-4791-84f9-aa0d0e0ea98e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:48.131993 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-f5628e36-d5e2-4791-84f9-aa0d0e0ea98e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097128 Aug 05 15:23:48.132548 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 15:23:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:50.336542 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-2f7c5182-f5cc-4403-95ac-33c0067fb1d3 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:50.337552 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-2f7c5182-f5cc-4403-95ac-33c0067fb1d3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 05 15:23:50.337949 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:50.734776 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-77a4ff99-b828-4eec-a60c-522e4b8cf73b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:50.818964 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-77a4ff99-b828-4eec-a60c-522e4b8cf73b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474655 Aug 05 15:23:50.819519 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 15:23:50.831293 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-60f24d15-9342-423e-b67a-b47240935fa4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:50.920053 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-60f24d15-9342-423e-b67a-b47240935fa4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092321 Aug 05 15:23:50.920651 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 15:23:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:53.125535 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-77a4ff99-b828-4eec-a60c-522e4b8cf73b admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:53.126822 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-77a4ff99-b828-4eec-a60c-522e4b8cf73b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 05 15:23:53.127471 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:53.482731 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-2a2df5fd-d41d-4d95-b928-9dcd5b87cbad admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:53.549636 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-2a2df5fd-d41d-4d95-b928-9dcd5b87cbad admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.416347 Aug 05 15:23:53.550184 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 15:23:53.562139 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-a9bb965a-5c31-418c-803b-03fb96719711 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:53.660037 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-a9bb965a-5c31-418c-803b-03fb96719711 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101396 Aug 05 15:23:53.660595 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 15:23:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:23:55.945999 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-2a2df5fd-d41d-4d95-b928-9dcd5b87cbad admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:55.947093 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-2a2df5fd-d41d-4d95-b928-9dcd5b87cbad admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 05 15:23:55.947570 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:56.398847 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-1d2d9142-d8d4-4bd2-a3b7-cc65c82e3819 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "disk": 80, "vcpus": 4, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:56.535946 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-1d2d9142-d8d4-4bd2-a3b7-cc65c82e3819 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.582411 Aug 05 15:23:56.537254 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:23:56.548757 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-1eff9a52-ba3f-49b5-81bf-a481fe260472 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:56.626239 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-1eff9a52-ba3f-49b5-81bf-a481fe260472 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081168 Aug 05 15:23:56.627507 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 15:23:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:23:58.849791 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-1d2d9142-d8d4-4bd2-a3b7-cc65c82e3819 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:23:58.853517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-1d2d9142-d8d4-4bd2-a3b7-cc65c82e3819 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Aug 05 15:23:58.853517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:23:59.292376 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-476a84e7-f048-4264-86eb-2ed5bf960e4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:59.378799 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-476a84e7-f048-4264-86eb-2ed5bf960e4f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.521343 Aug 05 15:23:59.379343 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 15:23:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:23:59.392046 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-4e7bdbaf-7a6f-4c43-b1b6-de25be8b3d1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:23:59.397232 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:23:59.476895 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-4e7bdbaf-7a6f-4c43-b1b6-de25be8b3d1d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088457 Aug 05 15:23:59.477407 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 15:23:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:24:20.153923 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-476a84e7-f048-4264-86eb-2ed5bf960e4f admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:20.154922 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-476a84e7-f048-4264-86eb-2ed5bf960e4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 05 15:24:20.155316 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:24:20.550536 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-0c8d4af6-0e0b-4c0a-b7fe-7a6b5ceb8340 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:20.568689 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-0c8d4af6-0e0b-4c0a-b7fe-7a6b5ceb8340 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407520 Aug 05 15:24:20.569222 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 5 15:24:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:24:21.621456 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-476a84e7-f048-4264-86eb-2ed5bf960e4f admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:21.622465 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-476a84e7-f048-4264-86eb-2ed5bf960e4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 05 15:24:21.622887 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:24:22.142574 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-6c07d079-8e62-40cd-b097-1507f21f7b3a admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:22.148197 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.wsgi [None req-6c07d079-8e62-40cd-b097-1507f21f7b3a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-6c07d079-8e62-40cd-b097-1507f21f7b3a admin admin] Request method failure captured: Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Accept: application/json Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Accept-Encoding: gzip, deflate Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Connection: keep-alive Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Content-Length: 0 Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Host: 10.222.0.40 Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Openstack-Api-Version: compute 2.90 Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Openstack-System-Scope: None Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: User-Agent: python-novaclient Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Auth-Token: gAAAAABi7TYlJ8DAvipcz5y7BBXFe5Up0cVn99LUM4lGtS0iWozgOo1YAmJX-rEGRqaOp0D_LRf2clr5TAbdpCoefqmCP5sFE6zscj3KPOlQ6puLwRj2dSajvbE5GE7RM7EWTzmAX-b3xYYEm78YCg4jcXIqU0Q15iaHT50zLgSbQVC8Cm-Eedo Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Domain-Id: None Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Domain-Name: None Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Identity-Status: Confirmed Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Is-Admin-Project: True Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Domain-Id: default Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Domain-Name: Default Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Name: admin Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Role: reader,admin,member Aug 05 15:24:22.151392 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Roles: reader,admin,member Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0744d3ce240a4f198b94f2d1e6d62c8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0744d3ce240a4f198b94f2d1e6d62c8e"}]}] Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant: admin Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant-Name: admin Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User: admin Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Domain-Id: default Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Domain-Name: Default Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Id: 338271833df8486b9ef50964b5ec7797 Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Name: admin Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: method: > Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: exception: Flavor 42 could not be found. Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: action_args: {'id': '42'} Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:24:22.153029 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:22.154042 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.155259 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-6c07d079-8e62-40cd-b097-1507f21f7b3a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:24:22.156638 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-6c07d079-8e62-40cd-b097-1507f21f7b3a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390898 Aug 05 15:24:22.156638 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 5 15:24:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 15:24:22.162492 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-65490d82-53d1-456b-b6c6-aa34061e5f40 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:22.167318 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:24:22.188366 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-65490d82-53d1-456b-b6c6-aa34061e5f40 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029332 Aug 05 15:24:22.188954 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 15:24:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:24:22.199124 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-13dd6fdd-1f02-4566-b8ab-d55944e4d5b0 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:22.222710 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-13dd6fdd-1f02-4566-b8ab-d55944e4d5b0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027248 Aug 05 15:24:22.223246 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 15:24:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:24:22.233584 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-4664bac5-8fb7-4e16-ba87-43b11708cbcf admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:22.239296 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.wsgi [None req-4664bac5-8fb7-4e16-ba87-43b11708cbcf admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-4664bac5-8fb7-4e16-ba87-43b11708cbcf admin admin] Request method failure captured: Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Accept: application/json Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Accept-Encoding: gzip, deflate Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Connection: keep-alive Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Content-Length: 0 Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Host: 10.222.0.40 Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Openstack-Api-Version: compute 2.90 Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Openstack-System-Scope: None Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: User-Agent: python-novaclient Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Auth-Token: gAAAAABi7TYlJ8DAvipcz5y7BBXFe5Up0cVn99LUM4lGtS0iWozgOo1YAmJX-rEGRqaOp0D_LRf2clr5TAbdpCoefqmCP5sFE6zscj3KPOlQ6puLwRj2dSajvbE5GE7RM7EWTzmAX-b3xYYEm78YCg4jcXIqU0Q15iaHT50zLgSbQVC8Cm-Eedo Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Domain-Id: None Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Domain-Name: None Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Identity-Status: Confirmed Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Is-Admin-Project: True Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Domain-Id: default Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Domain-Name: Default Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Name: admin Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Role: reader,admin,member Aug 05 15:24:22.243841 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Roles: reader,admin,member Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0744d3ce240a4f198b94f2d1e6d62c8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0744d3ce240a4f198b94f2d1e6d62c8e"}]}] Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant: admin Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant-Name: admin Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User: admin Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Domain-Id: default Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Domain-Name: Default Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Id: 338271833df8486b9ef50964b5ec7797 Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Name: admin Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: method: > Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: exception: Flavor 42 could not be found. Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: action_args: {'id': '42'} Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:24:22.260567 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:22.261528 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:22.262583 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-4664bac5-8fb7-4e16-ba87-43b11708cbcf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:24:22.263639 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-4664bac5-8fb7-4e16-ba87-43b11708cbcf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015626 Aug 05 15:24:22.263639 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 5 15:24:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 15:24:23.328975 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-13dd6fdd-1f02-4566-b8ab-d55944e4d5b0 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:23.329986 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-13dd6fdd-1f02-4566-b8ab-d55944e4d5b0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 05 15:24:23.330378 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:24:23.849331 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-cfefe7bd-70e4-46ef-a8d0-496095023f22 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:23.855170 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.wsgi [None req-cfefe7bd-70e4-46ef-a8d0-496095023f22 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-cfefe7bd-70e4-46ef-a8d0-496095023f22 admin admin] Request method failure captured: Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Accept: application/json Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Accept-Encoding: gzip, deflate Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Connection: keep-alive Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Content-Length: 0 Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Host: 10.222.0.40 Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Openstack-Api-Version: compute 2.90 Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Openstack-System-Scope: None Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: User-Agent: python-novaclient Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Auth-Token: gAAAAABi7TYnGTVtxAWlz4g4uIIfRzcACHK0r4s9bBXUT2brgWC4FyoIqOzYdHaekCmbImmcAUPtyhzxgoOrfj-Uz4i7Vn_aWHOezfCo1_TNwfWbetaclTX68QchF67lpxg1ElM0DS8VHWGw_sfULMtdNGzcpelqVSXZDCIuT_-tALoRV1isjmg Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Domain-Id: None Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Domain-Name: None Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Identity-Status: Confirmed Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Is-Admin-Project: True Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Domain-Id: default Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Domain-Name: Default Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Name: admin Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Role: reader,admin,member Aug 05 15:24:23.856700 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Roles: reader,admin,member Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0744d3ce240a4f198b94f2d1e6d62c8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0744d3ce240a4f198b94f2d1e6d62c8e"}]}] Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant: admin Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant-Name: admin Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User: admin Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Domain-Id: default Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Domain-Name: Default Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Id: 338271833df8486b9ef50964b5ec7797 Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Name: admin Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: method: > Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: exception: Flavor 84 could not be found. Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: action_args: {'id': '84'} Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:24:23.858270 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:23.859249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.860352 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-cfefe7bd-70e4-46ef-a8d0-496095023f22 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:24:23.861429 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-cfefe7bd-70e4-46ef-a8d0-496095023f22 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389605 Aug 05 15:24:23.861429 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 5 15:24:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 15:24:23.868314 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-331ad99a-e09d-4c45-86a5-64230831fa13 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:23.883256 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-331ad99a-e09d-4c45-86a5-64230831fa13 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019130 Aug 05 15:24:23.883733 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 15:24:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:24:23.892927 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-dd034f85-7464-4b59-86c2-ef36f2cee2ff admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:23.907705 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-dd034f85-7464-4b59-86c2-ef36f2cee2ff admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018224 Aug 05 15:24:23.908235 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 15:24:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:24:23.917561 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-96f3b8d0-0f1e-430d-a869-d8621bb8a173 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:23.922730 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.wsgi [None req-96f3b8d0-0f1e-430d-a869-d8621bb8a173 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-96f3b8d0-0f1e-430d-a869-d8621bb8a173 admin admin] Request method failure captured: Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Accept: application/json Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Accept-Encoding: gzip, deflate Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Connection: keep-alive Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Content-Length: 0 Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Host: 10.222.0.40 Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Openstack-Api-Version: compute 2.90 Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Openstack-System-Scope: None Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: User-Agent: python-novaclient Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Auth-Token: gAAAAABi7TYnGTVtxAWlz4g4uIIfRzcACHK0r4s9bBXUT2brgWC4FyoIqOzYdHaekCmbImmcAUPtyhzxgoOrfj-Uz4i7Vn_aWHOezfCo1_TNwfWbetaclTX68QchF67lpxg1ElM0DS8VHWGw_sfULMtdNGzcpelqVSXZDCIuT_-tALoRV1isjmg Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Domain-Id: None Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Domain-Name: None Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Identity-Status: Confirmed Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Is-Admin-Project: True Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Domain-Id: default Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Domain-Name: Default Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Name: admin Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Role: reader,admin,member Aug 05 15:24:23.924351 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Roles: reader,admin,member Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0744d3ce240a4f198b94f2d1e6d62c8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0744d3ce240a4f198b94f2d1e6d62c8e"}]}] Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant: admin Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant-Name: admin Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User: admin Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Domain-Id: default Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Domain-Name: Default Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Id: 338271833df8486b9ef50964b5ec7797 Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Name: admin Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: method: > Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: exception: Flavor 84 could not be found. Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: action_args: {'id': '84'} Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:24:23.925877 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:23.926837 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:23.928109 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-96f3b8d0-0f1e-430d-a869-d8621bb8a173 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:24:23.929949 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-96f3b8d0-0f1e-430d-a869-d8621bb8a173 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011602 Aug 05 15:24:23.929949 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 5 15:24:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 15:24:24.899243 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-dd034f85-7464-4b59-86c2-ef36f2cee2ff admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:24.900282 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-dd034f85-7464-4b59-86c2-ef36f2cee2ff admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 05 15:24:24.900702 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:24:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:24:25.415356 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-b1baa61e-efce-4be9-b75d-f0baed20f108 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:25.421030 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.wsgi [None req-b1baa61e-efce-4be9-b75d-f0baed20f108 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-b1baa61e-efce-4be9-b75d-f0baed20f108 admin admin] Request method failure captured: Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Accept: application/json Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Accept-Encoding: gzip, deflate Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Connection: keep-alive Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Content-Length: 0 Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Host: 10.222.0.40 Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Openstack-Api-Version: compute 2.90 Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Openstack-System-Scope: None Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: User-Agent: python-novaclient Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Auth-Token: gAAAAABi7TYoIT7pBtGRSFvQSxm2hbrCLQXQq7FL2jFKqoIKPa-DivVi_SyXZ8iDzSy6wBBxy9HCAmMjKQEyjG9_Zb9ZfkFtRZeAxuE64c5wx5e_wLvCoRGByi1Io3AI2_F0P-aMi83euaB3-rTlk0OwE6OLFhaFrcpcNzP3nk7fz1PbJp0K70Y Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Domain-Id: None Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Domain-Name: None Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Identity-Status: Confirmed Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Is-Admin-Project: True Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Domain-Id: default Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Domain-Name: Default Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Project-Name: admin Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Role: reader,admin,member Aug 05 15:24:25.422517 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Roles: reader,admin,member Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0744d3ce240a4f198b94f2d1e6d62c8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0744d3ce240a4f198b94f2d1e6d62c8e"}]}] Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant: admin Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-Tenant-Name: admin Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User: admin Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Domain-Id: default Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Domain-Name: Default Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Id: 338271833df8486b9ef50964b5ec7797 Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: X-User-Name: admin Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: method: > Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: exception: Flavor 451 could not be found. Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: action_args: {'id': '451'} Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:24:25.424014 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:25.425003 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.426388 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-b1baa61e-efce-4be9-b75d-f0baed20f108 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:24:25.427623 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-b1baa61e-efce-4be9-b75d-f0baed20f108 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387251 Aug 05 15:24:25.427623 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 15:24:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 15:24:25.434214 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-ea5838a4-a8b3-4ae4-b146-ba54e0188df2 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:25.448973 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-ea5838a4-a8b3-4ae4-b146-ba54e0188df2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018316 Aug 05 15:24:25.449516 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 15:24:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:24:25.458523 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:25.473005 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017914 Aug 05 15:24:25.473516 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 15:24:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:24:25.482652 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-582b0e67-0933-4b5e-929d-892c645165dd admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:25.487734 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.wsgi [None req-582b0e67-0933-4b5e-929d-892c645165dd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-582b0e67-0933-4b5e-929d-892c645165dd admin admin] Request method failure captured: Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Accept: application/json Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Accept-Encoding: gzip, deflate Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Connection: keep-alive Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Content-Length: 0 Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Host: 10.222.0.40 Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Openstack-Api-Version: compute 2.90 Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Openstack-System-Scope: None Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: User-Agent: python-novaclient Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Auth-Token: gAAAAABi7TYoIT7pBtGRSFvQSxm2hbrCLQXQq7FL2jFKqoIKPa-DivVi_SyXZ8iDzSy6wBBxy9HCAmMjKQEyjG9_Zb9ZfkFtRZeAxuE64c5wx5e_wLvCoRGByi1Io3AI2_F0P-aMi83euaB3-rTlk0OwE6OLFhaFrcpcNzP3nk7fz1PbJp0K70Y Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Domain-Id: None Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Domain-Name: None Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Identity-Status: Confirmed Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Is-Admin-Project: True Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Domain-Id: default Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Domain-Name: Default Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Project-Name: admin Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Role: reader,admin,member Aug 05 15:24:25.489248 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Roles: reader,admin,member Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0744d3ce240a4f198b94f2d1e6d62c8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0744d3ce240a4f198b94f2d1e6d62c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0744d3ce240a4f198b94f2d1e6d62c8e"}]}] Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant: admin Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant-Id: 0744d3ce240a4f198b94f2d1e6d62c8e Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-Tenant-Name: admin Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User: admin Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Domain-Id: default Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Domain-Name: Default Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Id: 338271833df8486b9ef50964b5ec7797 Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: X-User-Name: admin Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: method: > Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: exception: Flavor 451 could not be found. Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: action_args: {'id': '451'} Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:24:25.490827 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:25.492345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: ERROR nova.api.openstack.wsgi Aug 05 15:24:25.493617 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-582b0e67-0933-4b5e-929d-892c645165dd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:24:25.494875 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-582b0e67-0933-4b5e-929d-892c645165dd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011278 Aug 05 15:24:25.494875 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 15:24:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 05 15:24:26.487960 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:26.489041 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 05 15:24:26.489435 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:24:27.044406 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-e46a44e9-14d5-4d51-9063-aaac592c59dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:24:27.123398 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-e46a44e9-14d5-4d51-9063-aaac592c59dc admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.492828 Aug 05 15:24:27.123869 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 5 15:24:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:24:28.217598 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:28.218917 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001870 Aug 05 15:24:28.219626 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:24:28.749246 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-fca13ee8-6fe7-4357-a372-3e1513bf0cc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:24:28.871298 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-fca13ee8-6fe7-4357-a372-3e1513bf0cc2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.513703 Aug 05 15:24:28.871781 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 5 15:24:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:24:29.839515 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:29.840547 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 05 15:24:29.841121 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:24:30.368190 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-cb440a85-0926-4ec2-b928-d0b1163c3f30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:24:30.432265 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-cb440a85-0926-4ec2-b928-d0b1163c3f30 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.455106 Aug 05 15:24:30.432800 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 5 15:24:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 15:24:31.392192 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:31.393201 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 05 15:24:31.393589 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:24:31.913981 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-0f8fbfdb-f985-4f5c-94b0-6fa2c6167037 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:24:31.979935 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-0f8fbfdb-f985-4f5c-94b0-6fa2c6167037 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.447172 Aug 05 15:24:31.980503 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 5 15:24:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:24:32.942897 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:32.944479 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Aug 05 15:24:32.944874 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:24:33.463724 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-3b4c45de-6abf-43b8-bdbf-2b8118a01f83 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:24:33.490400 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-3b4c45de-6abf-43b8-bdbf-2b8118a01f83 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406676 Aug 05 15:24:33.491235 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Fri Aug 5 15:24:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:25:24.702733 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:25:24.703754 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-ef8185f8-e077-43c5-9538-acbdf441301a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 05 15:25:24.704181 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 15:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:25:24.715825 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:25:25.094690 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-ea71fefc-7452-401f-afc7-ab51dd66c9f7 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:25:25.115190 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-ea71fefc-7452-401f-afc7-ab51dd66c9f7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404619 Aug 05 15:25:25.116391 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 5 15:25:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:25:25.139612 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-9d9f7746-76e4-4aea-ac8a-cf4fed1504e8 admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:25:25.142956 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG dbcounter [-] [103764] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:25:25.147790 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-9d9f7746-76e4-4aea-ac8a-cf4fed1504e8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011887 Aug 05 15:25:25.153421 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Fri Aug 5 15:25:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:25:25.160233 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-c1067f41-1d74-4d21-9b70-99fd6e81a8ae admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:25:25.168615 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-c1067f41-1d74-4d21-9b70-99fd6e81a8ae admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012006 Aug 05 15:25:25.169866 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Fri Aug 5 15:25:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:25:25.181775 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:25:25.189414 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012159 Aug 05 15:25:25.189920 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Fri Aug 5 15:25:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:25:25.201446 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-201a1fd0-5f3e-459d-ac7d-a6437920dcd8 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:25:25.208892 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-201a1fd0-5f3e-459d-ac7d-a6437920dcd8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011056 Aug 05 15:25:25.209470 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Fri Aug 5 15:25:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:28:53.866643 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:28:53.867685 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 05 15:28:53.868102 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:28:54.007289 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_api:SELECT=6 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:28:54.164229 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-496b867d-c598-49b4-bd30-77f10e979c91 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:28:54.166519 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 15:28:54.166519 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: warnings.warn(msg) Aug 05 15:28:54.168164 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-496b867d-c598-49b4-bd30-77f10e979c91 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:28:54.168823 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-496b867d-c598-49b4-bd30-77f10e979c91 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:28:54.169249 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-496b867d-c598-49b4-bd30-77f10e979c91 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:28:54.169951 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-496b867d-c598-49b4-bd30-77f10e979c91 admin admin] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:28:54.170388 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-496b867d-c598-49b4-bd30-77f10e979c91 admin admin] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:28:54.170803 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-496b867d-c598-49b4-bd30-77f10e979c91 admin admin] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:28:54.204235 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-496b867d-c598-49b4-bd30-77f10e979c91 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198232 Aug 05 15:28:54.204789 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 15:28:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:28:55.033954 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:28:55.034969 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 05 15:28:55.035363 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:28:55.231786 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-f479bfcc-7615-4e6b-a7c0-01a7d7bc3347 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:28:55.234226 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 15:28:55.234226 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: warnings.warn(msg) Aug 05 15:28:55.235372 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-f479bfcc-7615-4e6b-a7c0-01a7d7bc3347 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:28:55.235861 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-f479bfcc-7615-4e6b-a7c0-01a7d7bc3347 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:28:55.236306 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-f479bfcc-7615-4e6b-a7c0-01a7d7bc3347 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:28:55.237013 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-f479bfcc-7615-4e6b-a7c0-01a7d7bc3347 admin admin] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:28:55.237452 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-f479bfcc-7615-4e6b-a7c0-01a7d7bc3347 admin admin] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:28:55.237859 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-f479bfcc-7615-4e6b-a7c0-01a7d7bc3347 admin admin] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:28:55.257124 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-f479bfcc-7615-4e6b-a7c0-01a7d7bc3347 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078885 Aug 05 15:28:55.257653 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 15:28:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:29:06.493924 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:29:06.498665 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 05 15:29:06.498665 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:29:06.641768 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_cell0:SELECT=4 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:29:06.642477 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_cell1:SELECT=4 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:29:06.643097 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG dbcounter [-] [103765] Writing DB stats nova_api:SELECT=8 {{(pid=103765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:29:06.690795 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-894ad136-0e33-4e11-b98b-126908378dfa admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:29:06.693211 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 15:29:06.693211 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: warnings.warn(msg) Aug 05 15:29:06.694365 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-894ad136-0e33-4e11-b98b-126908378dfa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:29:06.694831 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-894ad136-0e33-4e11-b98b-126908378dfa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:29:06.695264 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-894ad136-0e33-4e11-b98b-126908378dfa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:29:06.695977 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-894ad136-0e33-4e11-b98b-126908378dfa admin admin] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:29:06.696464 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-894ad136-0e33-4e11-b98b-126908378dfa admin admin] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:29:06.696876 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-894ad136-0e33-4e11-b98b-126908378dfa admin admin] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:29:06.723389 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-894ad136-0e33-4e11-b98b-126908378dfa admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085938 Aug 05 15:29:06.723860 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 15:29:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:29:07.555214 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: DEBUG nova.api.openstack.wsgi [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] Calling method '>' {{(pid=103764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:29:07.556255 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: INFO nova.api.openstack.requestlog [None req-c76521b5-06d0-45cf-a1f5-eeb7022566bd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 05 15:29:07.556648 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: [pid: 103764|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 15:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:29:07.745010 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG nova.api.openstack.wsgi [None req-eb36e55d-4f06-46f0-9d17-512f049df633 admin admin] Calling method '>' {{(pid=103765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:29:07.747621 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 15:29:07.747621 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: warnings.warn(msg) Aug 05 15:29:07.748735 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-eb36e55d-4f06-46f0-9d17-512f049df633 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:29:07.749210 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-eb36e55d-4f06-46f0-9d17-512f049df633 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:29:07.749638 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-eb36e55d-4f06-46f0-9d17-512f049df633 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:29:07.750345 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-eb36e55d-4f06-46f0-9d17-512f049df633 admin admin] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:29:07.750791 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-eb36e55d-4f06-46f0-9d17-512f049df633 admin admin] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:29:07.751209 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: DEBUG oslo_concurrency.lockutils [None req-eb36e55d-4f06-46f0-9d17-512f049df633 admin admin] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:29:07.772799 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: INFO nova.api.openstack.requestlog [None req-eb36e55d-4f06-46f0-9d17-512f049df633 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079029 Aug 05 15:29:07.773283 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: [pid: 103765|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 15:29:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:30:03.993153 dv-cinder-849890-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 15:30:03.994213 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: Fri Aug 5 15:30:03 2022 - graceful shutdown triggered... Aug 05 15:30:03.994716 dv-cinder-849890-4-iscsi devstack@n-api.service[103764]: Gracefully killing worker 1 (pid: 103764)... Aug 05 15:30:03.995107 dv-cinder-849890-4-iscsi devstack@n-api.service[103765]: Gracefully killing worker 2 (pid: 103765)... Aug 05 15:30:04.995348 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: worker 1 buried after 1 seconds Aug 05 15:30:04.995788 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: worker 2 buried after 1 seconds Aug 05 15:30:04.995788 dv-cinder-849890-4-iscsi devstack@n-api.service[103763]: goodbye to uWSGI. Aug 05 15:30:04.996964 dv-cinder-849890-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 15:30:04.997509 dv-cinder-849890-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 15:30:05.000352 dv-cinder-849890-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 15:30:05.009782 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 15:30:05 2022] *** Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: nodename: dv-cinder-849890-4-iscsi Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: machine: x86_64 Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: clock source: unix Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: pcre jit disabled Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: detected number of CPU cores: 4 Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: current working directory: / Aug 05 15:30:05.011753 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: detected binary path: /usr/bin/uwsgi-core Aug 05 15:30:05.012494 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: your processes number limit is 47680 Aug 05 15:30:05.012494 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: your memory page size is 4096 bytes Aug 05 15:30:05.012494 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: detected max file descriptor number: 2048 Aug 05 15:30:05.012494 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: lock engine: pthread robust mutexes Aug 05 15:30:05.012494 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: thunder lock: enabled Aug 05 15:30:05.012494 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 15:30:05.012494 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 15:30:05.051906 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: Python main interpreter initialized at 0x55ca2a3729c0 Aug 05 15:30:05.051906 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: python threads support enabled Aug 05 15:30:05.051906 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: your server socket listen backlog is limited to 100 connections Aug 05 15:30:05.051906 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: your mercy for graceful operations on workers is 90 seconds Aug 05 15:30:05.052449 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 15:30:05.052449 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: *** Operational MODE: preforking *** Aug 05 15:30:05.052670 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: *** uWSGI is running in multiple interpreter mode *** Aug 05 15:30:05.052670 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: spawned uWSGI master process (pid: 118721) Aug 05 15:30:05.052871 dv-cinder-849890-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 15:30:05.053475 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: spawned uWSGI worker 1 (pid: 118722, cores: 1) Aug 05 15:30:05.053837 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: spawned uWSGI worker 2 (pid: 118723, cores: 1) Aug 05 15:30:05.053983 dv-cinder-849890-4-iscsi devstack@n-api.service[118721]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 15:30:05.720998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 15:30:05.756537 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 15:30:06.861277 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 15:30:06.861277 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: from cryptography.utils import int_from_bytes Aug 05 15:30:06.861905 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 15:30:06.861905 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: from cryptography.utils import int_from_bytes Aug 05 15:30:06.914464 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 15:30:06.914464 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: from cryptography.utils import int_from_bytes Aug 05 15:30:06.915030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 15:30:06.915030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: from cryptography.utils import int_from_bytes Aug 05 15:30:09.216531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 15:30:09.217112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 15:30:09.217339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 15:30:09.217721 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 15:30:09.217983 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 15:30:09.218384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.218714 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.219039 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.219364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.219699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.220017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.220374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.220695 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.221025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.221289 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.221606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.221935 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-4-iscsi {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.222259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.222570 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.222882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.223203 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.223511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.223834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.224189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.224689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.225134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.225452 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.225771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.226140 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.226470 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.226775 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.227092 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.227411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.227735 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.228049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.228472 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-4-iscsi {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.228793 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.229111 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.229428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.229846 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.230162 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.230474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.230798 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.231124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.231440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.231769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.232123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.232454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.232780 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.233086 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.233401 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.233714 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.234037 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.234346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.234655 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.234912 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.235222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.235546 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.235870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.236217 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.236606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.236871 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.237196 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.237527 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.237839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.238153 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.238466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.238778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.239089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.239403 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.239717 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.240040 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.245568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.246405 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.246405 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.246620 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.246739 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.247210 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.247357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.247608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.247931 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.248267 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.248579 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.248889 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.249195 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.249505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.249813 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.250125 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.250433 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.250744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.251054 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.251367 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.251677 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.252027 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.252375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.252700 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.253011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.253322 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.253632 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.253942 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.254265 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.254574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.254883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.255208 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.255519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.255828 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.256173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.256485 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.256793 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.257115 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.257999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.258314 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.258637 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.258949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.259259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.259567 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.259876 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.260222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.260533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.260839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.261146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.261449 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.261772 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.262097 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.262409 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.262719 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.263030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.263351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.263690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.264026 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.264398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.264717 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.265056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.265395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.265720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.266037 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.266356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.266686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.267004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.267326 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.267642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.267964 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.268387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.268724 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.269045 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.269368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.269692 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.270011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.270336 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.270451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 15:30:09.270882 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 15:30:09.270977 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.270977 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.271133 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 15:30:09.271296 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.271466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 15:30:09.271645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.271893 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 15:30:09.271990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.272310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.272425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.272639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.272762 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.272994 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.273113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.273319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.273416 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.273646 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.273849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.273973 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.276132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.276261 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.276356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.276459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.276539 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.276612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.276691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.276776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.276852 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.276929 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.277002 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.277079 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-4-iscsi {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.277161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.277243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.277327 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.277398 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.277477 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.277555 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.277636 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.277715 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.277787 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.277858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.277935 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.278028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.278120 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.278203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.278284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.278366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.278444 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.278932 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.279042 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.279124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.279203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.279275 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.279354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.279569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.279667 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.279831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.279933 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.280153 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.280272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.280477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.280596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.280789 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.281092 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.281092 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.281395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.281503 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.281609 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.281749 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.281988 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-4-iscsi {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.282088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.282175 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.282387 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.282510 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.282701 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.282880 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.283011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.283114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.283331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.283431 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.283641 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.283741 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.283958 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.284059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.284298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.284433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.284660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.285577 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.286119 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.286224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.286312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.286397 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.286540 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.286676 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.286797 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.286797 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.286797 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.287635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.287732 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.287834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.287927 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.287927 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.288159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.288249 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.290000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.290114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.290205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.290205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.290442 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.290541 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.290659 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.290952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.291112 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.291329 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.291730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.291730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.292008 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.292114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.293831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.294032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.294134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.294240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.294336 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.294428 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.294521 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.294613 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.294699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.294799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.294887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.294972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.295056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.295140 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.295231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.295330 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.295427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.295512 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.295604 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.295696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.295782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.295874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.295968 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.296076 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.296217 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.296322 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.296494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.296591 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.296684 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.296776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.296872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.296970 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.297064 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.297156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.297255 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.297342 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.297435 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.297527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.297614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.297707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.297794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.297921 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.298023 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.298122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.298210 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.298313 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.298399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.298484 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.298567 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.298657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.298743 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.298843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.298930 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.299014 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.299098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.299188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.299275 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.299370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.299466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.299559 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.299559 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.299722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.299853 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.299949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.300198 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.300295 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.300518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.300611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.300835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.300945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.301140 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.301243 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.301438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.301568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.301743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.301841 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.302047 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.302152 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.302350 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.302452 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.302655 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.302750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.302960 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.303064 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.303262 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.303363 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.303567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.303661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.303871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.303975 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.304819 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.304939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.305139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.305242 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.305457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.305558 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.305762 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.305865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.306066 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.306161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.306371 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.306472 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.306681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.306804 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.307001 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.307111 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.307304 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.307403 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.307608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.307717 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.307927 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.308034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.308259 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.308384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.308565 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.308661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.308881 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.308977 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.309186 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.309289 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.309496 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.309597 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.309801 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.309902 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.310099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.310199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.310403 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.310511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.310719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.310825 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.311024 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.311128 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.311327 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.311471 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.311629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.311778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.311932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.312028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.312258 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.312369 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.312561 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.312665 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.312863 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.312957 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.313164 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.313319 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.313462 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.313565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.313777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.313914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.314094 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.314200 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.314400 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.314501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.314703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.314797 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.315007 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.315227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.315334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.315432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 15:30:09.315632 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.315734 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.316471 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.316649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.316811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.316967 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.317135 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.317289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.317444 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.317598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.317752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.317904 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.318050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.318193 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.318337 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.318495 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.318640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.318790 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.318935 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.319088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.319248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.319406 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.319552 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.319690 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.320329 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.320425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.320509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.320596 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.320738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.320844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.321070 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.321162 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.321389 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.321513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.321710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.321831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.322029 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.322167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.322344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.322439 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.322662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.322757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.322991 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.323093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.323303 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.323403 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.323615 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.323709 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.323930 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.324085 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.324424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.324739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.325064 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.325200 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.325393 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.325536 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.325708 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.325862 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.326016 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.326182 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.326328 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.326518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.326649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.326861 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.326964 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.327193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.327294 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.327520 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.327614 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.327845 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.327948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.328192 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.328303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.328503 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.328605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.328814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.328909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.329123 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.329420 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.329514 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.329765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.329865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.330078 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.330181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.330389 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.330490 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.330704 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.330797 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.331014 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.331107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.331323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.331425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.331632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.331770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.331934 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.332081 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.332273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.332380 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.332575 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.332687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.332883 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.332977 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.333186 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.333288 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.333504 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.333610 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.333832 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.333928 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.334139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.334286 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.334469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.334595 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.334775 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.334876 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.335085 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.335179 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.335418 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.335515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.335729 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.335823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.336034 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.336223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.336375 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.336474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.336664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.336780 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.336969 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.337101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.337292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.337527 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.337620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.337865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.337959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.338183 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.338286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.338496 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.338598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.338799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.338899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.339109 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.339205 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.339419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.339513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.339734 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.339834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.340044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.340203 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.340379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.340483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.340701 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.340802 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.341013 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.341115 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.341323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.341429 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.341657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.341751 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.341987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.342121 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.342292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.342420 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.342601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.342705 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.342919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.343020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.343231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.343331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.343536 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.343644 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.343844 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.343947 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.344173 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.344308 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.344478 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.344583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.344782 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.344885 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.345089 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.345183 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.345389 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.345497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.345693 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.345794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.345997 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.346161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.346299 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.346401 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.346602 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.346697 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.346916 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.347016 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.347222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.347351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.347520 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.347651 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.347826 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.347955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.348167 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.348513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.348821 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.348990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.349144 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.349307 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.349472 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.349625 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.349776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.349937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.350095 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.350327 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.350488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.350652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.350812 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.351002 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.351179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.351349 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.351453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.351541 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.351840 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360540 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360736 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.360928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361014 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361100 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361185 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361277 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361559 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361640 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361806 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.361901 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362226 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362307 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362307 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362465 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362547 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362702 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362869 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.362949 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363287 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363385 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363829 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363917 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.363998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364155 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364349 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364529 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.364696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.365937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.366235 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.368103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.368231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.368231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.368389 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.368468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.368550 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.368897 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.368992 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369082 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369155 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369467 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.369781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.370073 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.370387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.370552 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.370702 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.370899 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.371004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.371243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.371344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.371572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.371698 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.371948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.372050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.372292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.372389 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.372699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.372804 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.372909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.373015 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.373239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.373338 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.373808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.373912 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.373912 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.374086 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.374172 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.374366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.374463 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.374845 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.374943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.375033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.375108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.375264 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.375361 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.375702 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.375799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.375885 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.375966 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.376250 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.376366 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.376547 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.376653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.376891 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.376989 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.377209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.377307 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.377511 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.377616 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.377825 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.377932 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.378123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.378217 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.378470 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.378580 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.378770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.378867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.379044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.379143 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.379356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.379500 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.379685 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.379778 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.379960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.380052 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.380314 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.380413 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.380627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.380725 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.380962 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.381071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.381270 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.381390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.381673 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.381776 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.382033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.382179 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.383136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.383422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.383586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.383741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.383892 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.384044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.384253 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.384601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.384764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.384919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.385080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.385248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.385409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.385565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.385823 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.385997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.386160 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.386323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.386484 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.386640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.386811 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.386965 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.387117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.387283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.387445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.387601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.387760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.387913 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.388091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.388341 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.388341 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.388645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.388807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.388978 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.389146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.389301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.389301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.389599 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.389760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.389921 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.390089 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.390252 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.390405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.390564 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.390717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.390897 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.390897 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.391207 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.391367 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.391537 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.391698 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.391852 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.392011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.392268 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.392430 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.392596 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.392758 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.393182 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.393482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.393647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.393809 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.393974 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.394143 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.394298 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.394451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.394782 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.394947 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.395180 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.395346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.395501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.395662 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.395662 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.396152 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.396323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.396323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.396323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.396323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.396323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.396323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.397201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.397355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.397355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.397645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.397923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.398436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.398752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.399100 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.399440 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.399924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.400228 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.400604 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.400844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.401011 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.401263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.401567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.401740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.402003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.402307 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.402635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.402881 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.403720 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.403909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.404148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.404148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.404660 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.405247 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.405517 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.405772 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.405772 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.406358 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.406625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.406863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.407027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.407226 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.407475 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.407741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.407962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.407962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.408325 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.408521 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.408679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.408833 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.409005 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.409160 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.409323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.409492 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.409492 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.409833 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.409992 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.410154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.410317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.410317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.410618 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.410799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.410799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.411118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.411281 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.411281 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.411596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.411749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.411749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.412048 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.412241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.412241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.412533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.412834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.412834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.413157 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.413851 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.413851 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.414202 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.415857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.416037 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.416232 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.416527 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.416692 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.416692 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.416995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.417160 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.417364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.417553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.417709 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.417861 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.418023 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.418186 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.418340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.418493 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.418646 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.418805 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.418966 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.419135 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.419135 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.419435 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.419606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.419767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.419927 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.420139 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.420313 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.420475 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.420628 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.420788 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.420942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.421104 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.421266 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.421431 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.421586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.421794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.421965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.422120 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.422272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.422272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.422579 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.422579 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.422991 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.423162 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.423318 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.423915 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.424113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.424113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.424451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.424606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.424759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.424913 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.425171 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.425516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.425688 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.426023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.426185 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.426340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.426530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.426784 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.426965 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.427128 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.427290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.427446 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.427614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.427769 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.427924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.428179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.428350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.428554 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.428722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.428876 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.429527 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.429706 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.429868 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.430032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.430193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.430354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.430515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.430673 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.430826 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.430991 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.431146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.431306 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.431478 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.431653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.431816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.431978 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.432156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.432323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.432485 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.432638 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.432807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.432987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.433227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.433387 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.434073 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.434254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.434426 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.434582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.434734 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.434888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.435040 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.435208 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.435362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.435521 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.435683 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.435838 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.436259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.436436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.436604 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.436784 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.437039 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.437207 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.437371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.437535 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.437691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.437851 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.437851 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.438155 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.438315 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.438484 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.438650 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.438803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.438956 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.439110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.439278 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.439441 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.439595 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.439755 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.439910 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.440082 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.440255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.440411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.440563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.440727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.440887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.441040 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.441203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.441373 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.441538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.441700 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.441861 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.442021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.442188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.442361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.442625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.442808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.442984 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.443153 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.443409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.443572 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.443750 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.444363 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.444540 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.444540 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.445488 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.445651 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.445812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.445974 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.446262 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.446524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.446695 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.446858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.447031 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.447285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.447454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.447619 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.447782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.447936 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.448110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.448269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.448437 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.448722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.448899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.449063 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.449216 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.449369 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.449532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.449695 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.449849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.450010 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.450173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.450336 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.450499 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.450654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.450827 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.450989 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.451152 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.451305 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.451481 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.451641 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.451794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.451955 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.452129 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.452300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.452457 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.452611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.452764 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.452935 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.453090 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.453257 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.453439 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.453677 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.453848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.454021 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.454558 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.454738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.454902 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.455065 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.455220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.455390 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.455545 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.455706 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.455861 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.456021 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.456214 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.456452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.456728 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.456889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.457050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.457212 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.457466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.457466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.457791 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.457960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.458122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.458277 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.458436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.458598 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.458761 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.458924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.459077 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.459230 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.459391 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.459552 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.459809 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.459987 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.460203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.460390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.460555 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.460725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.460888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.461044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.461216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.461379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.461551 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.461551 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.461867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.462029 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.462203 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.462356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.462509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.462670 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.462824 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.462976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.462976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.463265 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.463433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.463597 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.463855 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.464017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.464219 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.464797 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.464974 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.465137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.465294 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.465447 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.465600 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.465792 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.465963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.466125 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.466287 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.466469 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.466719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.466981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.467153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.467318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.467492 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.467747 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.467906 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.468087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.468250 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.468405 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.468557 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.468710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.468881 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.469051 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.469216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.469379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.469542 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.469710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.469865 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.470106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.470106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.470427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.470427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.470727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.470881 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.471048 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.471213 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.471368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.471531 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.471685 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.471846 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.472000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.472209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.472366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.472521 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.472674 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.472836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.472992 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.473145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.473309 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.473470 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.473633 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.473796 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.474053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.474216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.474378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.474947 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.475127 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.475291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.475291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.475603 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.475771 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.475965 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.476158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.476327 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.476481 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.476642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.479384 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.479571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.479749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.479922 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.480110 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.480285 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.480450 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.480623 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.480788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.480944 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.481096 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.481257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.481418 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.481591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.481756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.481919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.482081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.482236 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.482408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.482716 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.482881 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.483037 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.483198 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.483354 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.483506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.483670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.483839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.484017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.484322 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.484480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.485544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.485716 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.485894 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.486058 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.486214 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.486375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.486539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.486702 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.486875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.487103 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.487273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.487428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.487591 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.487746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.487746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.488047 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.488238 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.488402 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.488519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.488609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.488737 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.488832 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.488921 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489262 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489708 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489955 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.489955 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.490174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.490174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.490499 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.490635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.490758 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.490873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.490993 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.491107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.491219 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.491346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.491467 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.492159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.492298 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.492414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.492537 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.492659 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.492773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.492892 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.493013 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.493127 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.493248 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.493363 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.493474 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.493847 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.493965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.494163 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.494304 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.494507 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.494627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.494762 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.494969 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.495106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.495222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.495364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.495731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.495870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.495993 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.496218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.496340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.496454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.496567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.496681 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.496793 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.496917 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.497038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.497261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.497382 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.497505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.497630 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.497746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.497859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.497981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.498095 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.498209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.498331 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.498446 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.498567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.498690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.498813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.498929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.499051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.499174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.499295 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.499411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.499525 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.499800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.499800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.500030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.500182 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.500308 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.500423 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.500689 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.501049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.501179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.501179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.501179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.501179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.501179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.502823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.502950 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.503335 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.503464 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.503595 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.503719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.503835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.503956 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.504130 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.504265 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.504444 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.504744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.504907 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.505203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.505203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.505522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.505522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.506263 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.506423 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.506586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.506741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.506936 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.507164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.507957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.508141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.508315 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.508479 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.508643 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.508799 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.508974 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509129 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509283 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509439 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 15:30:09.509608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.509608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.511243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.511243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.511243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.511243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.511243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.511243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.511243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.511243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.512623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.512623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.512623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.512623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.512623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.512623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.512623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.512623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.513870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.513870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.513870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.513870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.513870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.513870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.513870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.513870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.517008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.517008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.517008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.517008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.517008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.517008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.517008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.517008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.518325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.518325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.518325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.518325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.518325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.518325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.519197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.519197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.519197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.519645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.519645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.519937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.520327 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.520652 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.521015 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.521337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.521658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.521981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.522303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.522622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.522976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.523295 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.523612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.523941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.524350 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.524674 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.525117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.525579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.525760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.526194 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.526663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.526825 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.527020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.527350 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.527667 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.527995 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.528360 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.528693 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.529043 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.529378 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.529711 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.530023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.530476 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.530659 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.530947 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.531273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.531593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.531897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.532247 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.532537 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.532849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.533161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.533470 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.533788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.534087 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.534396 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.534703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.535010 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.535323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.535732 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.535932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.536395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.536834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.536997 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.537201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.537514 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.537821 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.538873 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.539234 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.539571 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.539911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.540270 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.540666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.540927 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.541261 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.541695 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.541919 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.542240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.543286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.543286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.543286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.543783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.543947 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.544165 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.544942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.544942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.545296 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.545592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.545787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.546080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.546556 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.546985 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.547176 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.547425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.547746 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.548122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.548407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.548719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.549034 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.549330 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.549645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.549961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.550284 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.550608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.551566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.551566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.551566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.552237 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.552237 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.552682 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.552919 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.553274 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.553610 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.553939 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.554803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.555117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 15:30:09.555370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 15:30:09.649044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO dbcounter [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Registered counter for database nova_api Aug 05 15:30:09.670072 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_db.sqlalchemy.engines [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:30:09.676706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writer thread running {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:30:09.705793 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO dbcounter [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Registered counter for database nova_api Aug 05 15:30:09.725458 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_db.sqlalchemy.engines [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:30:09.732773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writer thread running {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:30:09.733720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.context [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2afb463e-7116-427f-86ac-1e9017fa5c96(cell1) {{(pid=118722) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 15:30:09.737751 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:30:09.738231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:30:09.739804 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:30:09.740549 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:30:09.741000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:30:09.743954 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:30:09.745969 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO dbcounter [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Registered counter for database nova_cell0 Aug 05 15:30:09.749970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO dbcounter [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Registered counter for database nova_cell1 Aug 05 15:30:09.757067 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_db.sqlalchemy.engines [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:30:09.759321 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_db.sqlalchemy.engines [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:30:09.764410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writer thread running {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:30:09.767038 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writer thread running {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:30:09.789508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.context [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2afb463e-7116-427f-86ac-1e9017fa5c96(cell1) {{(pid=118723) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 15:30:09.793529 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:30:09.794005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:30:09.795579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:30:09.796319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:30:09.796769 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:30:09.798773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:30:09.800769 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO dbcounter [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Registered counter for database nova_cell0 Aug 05 15:30:09.805353 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO dbcounter [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Registered counter for database nova_cell1 Aug 05 15:30:09.812523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_db.sqlalchemy.engines [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:30:09.813826 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_db.sqlalchemy.engines [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:30:09.820798 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writer thread running {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:30:09.822099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writer thread running {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:30:09.911462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO dbcounter [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Registered counter for database nova_cell0 Aug 05 15:30:09.918853 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_db.sqlalchemy.engines [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:30:09.923722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writer thread running {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:30:09.965713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO dbcounter [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Registered counter for database nova_cell0 Aug 05 15:30:09.972727 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_db.sqlalchemy.engines [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 15:30:09.977630 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writer thread running {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 15:30:10.246185 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: WARNING keystonemiddleware.auth_token [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 15:30:10.254614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: WARNING keystonemiddleware.auth_token [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 15:30:10.292453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: WARNING keystonemiddleware.auth_token [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 15:30:10.299667 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: WARNING keystonemiddleware.auth_token [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 15:30:10.600465 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: WARNING keystonemiddleware.auth_token [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 15:30:10.606965 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: WARNING keystonemiddleware.auth_token [None req-e7379082-f225-4576-b116-e1f5fe96ce7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 15:30:10.613266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ca2a3729c0 pid: 118722 (default app) Aug 05 15:30:10.640914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: WARNING keystonemiddleware.auth_token [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 15:30:10.646942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: WARNING keystonemiddleware.auth_token [None req-59758557-31cd-46e0-8e54-1f74f2b9ac6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 15:30:10.653179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ca2a3729c0 pid: 118723 (default app) Aug 05 15:30:47.701533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:30:47.702766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:30:47.703583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:30:47.704368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:30:48.520525 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-17cb6f4a-8403-4323-b63c-c302e70eff46 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Action: 'create', calling method: .version_select at 0x7fcb16e48f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-104438327", "metadata": {"Type": "work"}}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-17cb6f4a-8403-4323-b63c-c302e70eff46 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Request method failure captured: Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 121 Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TenwASlI3uepmfl13nPpA_oajyTu0K8l9Hn7usbzOBr0RKV680qZPcH7FqvKxZuvKLgvoHVTrbBsswlCsNS_qT9z9nipYuqWfeN31u2j0HzrEFFAmI4Wv3iKpuruN0GDYIKmTcpBiolM6WjwzfDkmFoYYO31Ds8fWTnOthALEMmnOk Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:30:48.526016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_521158d79b45465298460c240f399055", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/521158d79b45465298460c240f399055"}]}] Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: be954cca051f450f845c206c7655d841 Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-104438327", "metadata": {"Type": "work"}}} Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: Aug 05 15:30:48.527357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-104438327', 'metadata': {'Type': 'work'}}}} Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise error Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:30:48.528227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 15:30:48.530290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 15:30:48.531720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 15:30:48.531720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.531720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-17cb6f4a-8403-4323-b63c-c302e70eff46 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:30:48.531720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-17cb6f4a-8403-4323-b63c-c302e70eff46 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.837040 Aug 05 15:30:48.531720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 5 15:30:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 839 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:30:48.542001 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=3 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:30:48.545122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=3 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:30:48.546816 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=3 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:30:48.549212 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=3 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:30:48.858375 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-12f77a9c-73fe-4254-8b0a-28a5ab30ac47 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Action: 'create', calling method: .version_select at 0x7fcb16eb79d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-425675954", "metadata": {"Type": "work"}}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-12f77a9c-73fe-4254-8b0a-28a5ab30ac47 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Request method failure captured: Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 119 Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TenwASlI3uepmfl13nPpA_oajyTu0K8l9Hn7usbzOBr0RKV680qZPcH7FqvKxZuvKLgvoHVTrbBsswlCsNS_qT9z9nipYuqWfeN31u2j0HzrEFFAmI4Wv3iKpuruN0GDYIKmTcpBiolM6WjwzfDkmFoYYO31Ds8fWTnOthALEMmnOk Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:30:48.865349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_521158d79b45465298460c240f399055", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/521158d79b45465298460c240f399055"}]}] Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: be954cca051f450f845c206c7655d841 Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-425675954", "metadata": {"Type": "work"}}} Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: Aug 05 15:30:48.872786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-425675954', 'metadata': {'Type': 'work'}}}} Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise error Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi '0' Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:30:48.873707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 15:30:48.875246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 15:30:48.877405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 15:30:48.877405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.877405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-12f77a9c-73fe-4254-8b0a-28a5ab30ac47 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:30:48.877405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-12f77a9c-73fe-4254-8b0a-28a5ab30ac47 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.331333 Aug 05 15:30:48.877405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 1/2] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 5 15:30:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 334 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:30:48.880006 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1462b467-aea6-48cf-aa1f-b069fa8b07a9 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Action: 'create', calling method: .version_select at 0x7fcb16defaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1737590785", "metadata": {"Type": "work"}}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1462b467-aea6-48cf-aa1f-b069fa8b07a9 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Request method failure captured: Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 119 Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TenwASlI3uepmfl13nPpA_oajyTu0K8l9Hn7usbzOBr0RKV680qZPcH7FqvKxZuvKLgvoHVTrbBsswlCsNS_qT9z9nipYuqWfeN31u2j0HzrEFFAmI4Wv3iKpuruN0GDYIKmTcpBiolM6WjwzfDkmFoYYO31Ds8fWTnOthALEMmnOk Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:30:48.884355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_521158d79b45465298460c240f399055", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/521158d79b45465298460c240f399055"}]}] Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: be954cca051f450f845c206c7655d841 Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1737590785", "metadata": {"Type": "work"}}} Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: Aug 05 15:30:48.885629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1737590785', 'metadata': {'Type': 'work'}}}} Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise error Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi '' Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:30:48.886592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 15:30:48.889044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 15:30:48.891606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 15:30:48.891606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:48.891606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1462b467-aea6-48cf-aa1f-b069fa8b07a9 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:30:48.891606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1462b467-aea6-48cf-aa1f-b069fa8b07a9 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010460 Aug 05 15:30:48.891606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 2/3] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 5 15:30:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:30:48.906171 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e84d3c41-6e19-43b8-bce1-9ab14c06c6a3 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Calling method '.version_select at 0x7fcb16eb7310>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:49.436487 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-e84d3c41-6e19-43b8-bce1-9ab14c06c6a3 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] HTTP exception thrown: Volume tempest-invalid-1104358440 could not be found. Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e84d3c41-6e19-43b8-bce1-9ab14c06c6a3 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Request method failure captured: Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1104358440 HTTP/1.1 Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TenwASlI3uepmfl13nPpA_oajyTu0K8l9Hn7usbzOBr0RKV680qZPcH7FqvKxZuvKLgvoHVTrbBsswlCsNS_qT9z9nipYuqWfeN31u2j0HzrEFFAmI4Wv3iKpuruN0GDYIKmTcpBiolM6WjwzfDkmFoYYO31Ds8fWTnOthALEMmnOk Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:30:49.440788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_521158d79b45465298460c240f399055", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/521158d79b45465298460c240f399055"}]}] Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: be954cca051f450f845c206c7655d841 Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Volume tempest-invalid-1104358440 could not be found. Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': 'tempest-invalid-1104358440'} Aug 05 15:30:49.442354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1104358440 could not be found. (HTTP 404) (Request-ID: req-6974fc87-f520-4f06-95fc-efba7906d663) Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:49.443285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 15:30:49.444669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1104358440 could not be found. Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:30:49.446593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1104358440 could not be found. Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1104358440 could not be found. Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.448477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e84d3c41-6e19-43b8-bce1-9ab14c06c6a3 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Returning 404 to user: Volume tempest-invalid-1104358440 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:30:49.449267 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e84d3c41-6e19-43b8-bce1-9ab14c06c6a3 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1104358440" status: 404 len: 99 microversion: 2.1 time: 0.550946 Aug 05 15:30:49.455064 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 15:30:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1104358440 => generated 99 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 15:30:49.460094 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a282058a-2832-4317-9cc2-c09c802533ad tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004304 Aug 05 15:30:49.460579 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Aug 5 15:30:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 15:30:49.472768 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-46bfcfb5-2649-4f6e-820e-c4409ca24a78 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006250 Aug 05 15:30:49.474289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1137 bytes} [Fri Aug 5 15:30:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 15:30:49.486807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f576ac8e-db7b-4a9d-bba5-a1133ed79c92 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Calling method '.version_select at 0x7fcb16d15ca0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:49.747002 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-f576ac8e-db7b-4a9d-bba5-a1133ed79c92 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] HTTP exception thrown: Volume ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb could not be found. Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f576ac8e-db7b-4a9d-bba5-a1133ed79c92 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Request method failure captured: Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: DELETE /compute/v2.1/os-volumes/ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb HTTP/1.1 Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TenwASlI3uepmfl13nPpA_oajyTu0K8l9Hn7usbzOBr0RKV680qZPcH7FqvKxZuvKLgvoHVTrbBsswlCsNS_qT9z9nipYuqWfeN31u2j0HzrEFFAmI4Wv3iKpuruN0GDYIKmTcpBiolM6WjwzfDkmFoYYO31Ds8fWTnOthALEMmnOk Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:30:49.752725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_521158d79b45465298460c240f399055", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/521158d79b45465298460c240f399055"}]}] Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: be954cca051f450f845c206c7655d841 Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Volume ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb could not be found. Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb'} Aug 05 15:30:49.754860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb could not be found. (HTTP 404) (Request-ID: req-180ed9eb-3337-403b-a45f-044ac5dfe910) Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:49.755773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 15:30:49.757093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb could not be found. Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 15:30:49.765061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb could not be found. Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb could not be found. Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f576ac8e-db7b-4a9d-bba5-a1133ed79c92 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Returning 404 to user: Volume ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f576ac8e-db7b-4a9d-bba5-a1133ed79c92 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb" status: 404 len: 109 microversion: 2.1 time: 0.274106 Aug 05 15:30:49.766532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:30:49 2022] DELETE /compute/v2.1/os-volumes/ca9dd9eb-efa6-4ab5-89fe-8c279e9bcbcb => generated 109 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 15:30:49.773158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3e1c6af6-8394-45d1-9021-ab6af1d48966 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Calling method '.version_select at 0x7fcb16c47670>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:49.833312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-3e1c6af6-8394-45d1-9021-ab6af1d48966 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] HTTP exception thrown: Volume f15dd65a-92de-4b61-bf16-ca4371fee0e9 could not be found. Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3e1c6af6-8394-45d1-9021-ab6af1d48966 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Request method failure captured: Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/os-volumes/f15dd65a-92de-4b61-bf16-ca4371fee0e9 HTTP/1.1 Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TenwASlI3uepmfl13nPpA_oajyTu0K8l9Hn7usbzOBr0RKV680qZPcH7FqvKxZuvKLgvoHVTrbBsswlCsNS_qT9z9nipYuqWfeN31u2j0HzrEFFAmI4Wv3iKpuruN0GDYIKmTcpBiolM6WjwzfDkmFoYYO31Ds8fWTnOthALEMmnOk Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:30:49.835513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_521158d79b45465298460c240f399055", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/521158d79b45465298460c240f399055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/521158d79b45465298460c240f399055"}]}] Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 521158d79b45465298460c240f399055 Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-VolumesNegativeTest-406318484 Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: be954cca051f450f845c206c7655d841 Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-VolumesNegativeTest-406318484-project Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Volume f15dd65a-92de-4b61-bf16-ca4371fee0e9 could not be found. Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': 'f15dd65a-92de-4b61-bf16-ca4371fee0e9'} Aug 05 15:30:49.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f15dd65a-92de-4b61-bf16-ca4371fee0e9 could not be found. (HTTP 404) (Request-ID: req-ccf4141d-5f8a-4902-b063-cba5b5a8ea74) Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:49.838039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:30:50.150038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f15dd65a-92de-4b61-bf16-ca4371fee0e9 could not be found. Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 15:30:50.152968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f15dd65a-92de-4b61-bf16-ca4371fee0e9 could not be found. Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f15dd65a-92de-4b61-bf16-ca4371fee0e9 could not be found. Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3e1c6af6-8394-45d1-9021-ab6af1d48966 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] Returning 404 to user: Volume f15dd65a-92de-4b61-bf16-ca4371fee0e9 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3e1c6af6-8394-45d1-9021-ab6af1d48966 tempest-VolumesNegativeTest-406318484 tempest-VolumesNegativeTest-406318484-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f15dd65a-92de-4b61-bf16-ca4371fee0e9" status: 404 len: 109 microversion: 2.1 time: 0.073524 Aug 05 15:30:50.160005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:30:49 2022] GET /compute/v2.1/os-volumes/f15dd65a-92de-4b61-bf16-ca4371fee0e9 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:30:51.273455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4460e830-ee00-4aaf-8ad4-fb7ab3761f0c tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c5d790>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:51.375801 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4460e830-ee00-4aaf-8ad4-fb7ab3761f0c tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6acfba58-3d9e-4131-9234-9f7e29db77d2" status: 200 len: 351 microversion: 2.1 time: 0.106278 Aug 05 15:30:51.384085 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:30:51 2022] GET /compute/v2.1/os-volumes/6acfba58-3d9e-4131-9234-9f7e29db77d2 => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:30:53.368123 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-013624a6-3656-4f60-9640-07924023a9bc tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c5a0d0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:53.512625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-013624a6-3656-4f60-9640-07924023a9bc tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f80a23b5-8247-495b-9453-f691dd1c111b" status: 200 len: 351 microversion: 2.1 time: 0.161706 Aug 05 15:30:53.521556 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 5/10] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:30:53 2022] GET /compute/v2.1/os-volumes/f80a23b5-8247-495b-9453-f691dd1c111b => generated 351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:30:56.011304 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8fd73dcf-a8f2-4cff-b215-052673540a57 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c5dee0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:56.114135 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8fd73dcf-a8f2-4cff-b215-052673540a57 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/de1bc826-3335-4e8d-aceb-07c2e9837963" status: 200 len: 351 microversion: 2.1 time: 0.107232 Aug 05 15:30:56.114770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:30:56 2022] GET /compute/v2.1/os-volumes/de1bc826-3335-4e8d-aceb-07c2e9837963 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:30:56.129028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-482ebbcc-4f12-4099-be64-6255f4957987 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c5a790>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:56.387587 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-482ebbcc-4f12-4099-be64-6255f4957987 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.262821 Aug 05 15:30:56.402690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-83ebb122-eb36-4335-b620-fab7a8f47885 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c5dca0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:56.403072 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Aug 5 15:30:56 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:30:56.573887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-83ebb122-eb36-4335-b620-fab7a8f47885 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.174896 Aug 05 15:30:56.590325 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1149 bytes} [Fri Aug 5 15:30:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:30:56.593107 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5e0cc09a-3cdc-49e5-9424-bc50b290ace7 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c474c0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:56.792722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5e0cc09a-3cdc-49e5-9424-bc50b290ace7 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.204939 Aug 05 15:30:56.793509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 7/14] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Aug 5 15:30:56 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:30:56.807117 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7c2026ab-a1d5-468e-a512-4cc08cde7f15 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c69940>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:57.055058 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7c2026ab-a1d5-468e-a512-4cc08cde7f15 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.252208 Aug 05 15:30:57.055667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1167 bytes} [Fri Aug 5 15:30:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:30:57.071048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef7a06a6-19b1-4a6e-9bc5-179a4634b05c tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c62310>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:57.239522 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ef7a06a6-19b1-4a6e-9bc5-179a4634b05c tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.173648 Aug 05 15:30:57.241710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1170 bytes} [Fri Aug 5 15:30:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:30:57.253513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2dbd7fc9-ac17-42a9-adae-5f00d7151796 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c698b0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:57.462432 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2dbd7fc9-ac17-42a9-adae-5f00d7151796 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.212494 Aug 05 15:30:57.463189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 9/17] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Aug 5 15:30:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:30:57.476781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c69d2577-dee6-49f8-a437-430f4faa3e40 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c63550>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:58.086280 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c69d2577-dee6-49f8-a437-430f4faa3e40 tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.613389 Aug 05 15:30:58.089117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 9/18] 10.222.0.40 () {58 vars in 1188 bytes} [Fri Aug 5 15:30:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:30:58.118941 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f347ba83-329c-4aea-bce8-b4890667470a tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] Calling method '.version_select at 0x7fcb16c5d9d0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:30:58.373533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f347ba83-329c-4aea-bce8-b4890667470a tempest-VolumesTestJSON-553883406 tempest-VolumesTestJSON-553883406-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.271181 Aug 05 15:30:58.373533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 10/19] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Aug 5 15:30:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:30:59.363798 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-981951483", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:30:59.562911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] validate_networks() for [('51a7564f-6f88-44aa-8bd2-cac8188d6f98', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:31:01.262222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:31:01.262222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:31:01.262222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:31:01.262222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:31:01.262222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:31:01.277705 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:01.279801 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:01.281543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:01.283039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:01.285398 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:01.290585 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:01.328498 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Getting quotas for project 1cb48dbd26c747d290bf3e666e65027a. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:31:01.339083 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Getting quotas for user cb055110c77543c1861dfd8c155d7582 and project 1cb48dbd26c747d290bf3e666e65027a. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:31:01.354705 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:31:01.360833 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:31:01.604631 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5b5fa0e0-1369-4dc2-a6e2-82c983d04ec2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.455064 Aug 05 15:31:01.605804 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 10/20] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:30:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:31:01.633188 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d616bbd0-6865-485c-a78c-c19711d35314 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:01.633188 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d616bbd0-6865-485c-a78c-c19711d35314 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:01.894697 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d616bbd0-6865-485c-a78c-c19711d35314 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:01.920907 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d616bbd0-6865-485c-a78c-c19711d35314 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1221 microversion: 2.1 time: 0.306922 Aug 05 15:31:01.921522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 11/21] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:01 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1221 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:02.340990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1841187352", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:02.441468 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] validate_networks() for [('51a7564f-6f88-44aa-8bd2-cac8188d6f98', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:31:03.713948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:31:03.713948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:31:03.713948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:31:03.713948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:31:03.713948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:31:03.717145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:03.717145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:03.717145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:03.717145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:03.718003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:03.718003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:03.718003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Getting quotas for project 1cb48dbd26c747d290bf3e666e65027a. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:31:03.718003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Getting quotas for user cb055110c77543c1861dfd8c155d7582 and project 1cb48dbd26c747d290bf3e666e65027a. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:31:03.718391 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:31:03.718391 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:31:03.928296 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6d99c050-c14c-4a66-a661-7f3bf398ec9d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.593440 Aug 05 15:31:03.941509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 11/22] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:31:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:31:03.958680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-924f130e-3e68-4dfc-baa9-2240d06a974e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:03.959452 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-924f130e-3e68-4dfc-baa9-2240d06a974e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:04.766173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-924f130e-3e68-4dfc-baa9-2240d06a974e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:04.777738 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-924f130e-3e68-4dfc-baa9-2240d06a974e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1222 microversion: 2.1 time: 0.822890 Aug 05 15:31:04.782570 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:03 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1222 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:05.799433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:05.800134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:05.820214 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:05.820564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:05.821986 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:05.824412 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:05.828627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:05.829281 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:06.214321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:06.242550 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7137f90a-d887-4d04-a981-0b8e8839864b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1226 microversion: 2.1 time: 0.446684 Aug 05 15:31:06.246523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:05 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1226 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:06.773180 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1131009105", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "networks": [{"uuid": "9a1c0f0f-08e4-4603-b269-a0bfc5e39497"}]}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:07.040042 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] validate_networks() for [('9a1c0f0f-08e4-4603-b269-a0bfc5e39497', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:31:07.267924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:07.270565 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:07.290314 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:07.300579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:07.303639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:07.309381 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:07.310733 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:07.313148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:07.532141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:07.542102 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c8449dcb-b7a0-4921-9db8-2665965ba3fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1226 microversion: 2.1 time: 0.279084 Aug 05 15:31:07.566127 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:07 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1226 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:08.567256 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:08.568996 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:08.595928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:08.602466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:08.602466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:08.602466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:08.605670 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:08.607289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:08.814678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:08.846229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-47a9306c-6532-48c9-8b5a-6df09f7daa58 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1282 microversion: 2.1 time: 0.283037 Aug 05 15:31:08.849327 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 14/26] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:08 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:09.353575 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1b02363b-b918-4701-8be9-88a7f1c63d61 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'create', calling method: .version_select at 0x7fcb15a4ba60>, body: {"keypair": {"name": "tempest-keypair-506535949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArBSVnQ1TXgi0taM5DqPcC4QawktemHRuLl2PogrLZum3r/qCtODSDYFbtnbheQ9M3IVrZ5bY7mCRZSZdp+XxCTEgwOHT/aFfDLZ5s7Ek5XVlV5Ibkh3XLiZ/d2Qxf4eg=="}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:09.449466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-1b02363b-b918-4701-8be9-88a7f1c63d61 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Getting quotas for project f9776de9e6d341fdbf7ac4fa70b994aa. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:31:09.481853 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-1b02363b-b918-4701-8be9-88a7f1c63d61 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Getting quotas for user 04e80222936d4427909414a78e1dc489 and project f9776de9e6d341fdbf7ac4fa70b994aa. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:31:09.678889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1b02363b-b918-4701-8be9-88a7f1c63d61 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.828068 Aug 05 15:31:09.680684 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 15/27] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:31:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:09.876691 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:09.878660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:09.926239 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:09.929255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:09.932327 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:09.935728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:09.941504 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:09.941504 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:10.679890 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:10.689646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7d1b1b78-00bf-4483-bdda-9bcc4fa982f9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1280 microversion: 2.1 time: 0.822370 Aug 05 15:31:10.714837 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 16/28] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:09 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1280 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:11.129429 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3992ab99-aefe-49f8-93b0-c5800f6fe906 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'create', calling method: .version_select at 0x7fcb15a4baf0>, body: {"keypair": {"name": "tempest-keypair-1204001639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgTeWviJeuHnvwIM8CX33bpXW87s+iGI8AS52Bhw/aFUdyfVwYz/SNMZn+kgcZWvHzSUZlakOUjK321SNnmgZWvnAIrLuEAO5C9oTDsWgjESIka3VdeHmvm6Xccb/4xow=="}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:11.164456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-3992ab99-aefe-49f8-93b0-c5800f6fe906 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Getting quotas for project 648f7ac8fb934441b6782d00d0b5ef10. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:31:11.167143 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:31:11.173753 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:31:11.173753 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:31:11.173753 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:31:11.173753 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:31:11.174087 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-3992ab99-aefe-49f8-93b0-c5800f6fe906 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Getting quotas for user d36b38a6e2d34c41b827ff6db9742332 and project 648f7ac8fb934441b6782d00d0b5ef10. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:31:11.199923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:11.200454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:11.200966 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:11.205683 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:11.206461 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:11.207097 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:11.300258 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3992ab99-aefe-49f8-93b0-c5800f6fe906 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.583605 Aug 05 15:31:11.301449 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 17/29] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Aug 5 15:31:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 586 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 15:31:11.436191 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Getting quotas for project 020b2f0e82d14211b286f1ac1e3823a9. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:31:11.475645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Getting quotas for user b0882cb9bf4744feae298fb8f10cebeb and project 020b2f0e82d14211b286f1ac1e3823a9. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:31:11.550417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:31:11.570340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:31:11.720117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:11.723714 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:11.734196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:11.734763 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:11.735214 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:11.735943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:11.754064 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:11.754975 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:11.961539 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e37dbd9d-2813-4cc9-bd84-fa773426fbd0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.691617 Aug 05 15:31:11.962637 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 13/30] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 5693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 15:31:11.978046 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-bd0b28fc-4e52-431d-9106-5bb6fd2b3138 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:11.982193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-bd0b28fc-4e52-431d-9106-5bb6fd2b3138 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:12.112902 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:12.125553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-be126cfb-be03-45fd-b262-f5fbe928b8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1280 microversion: 2.1 time: 0.409352 Aug 05 15:31:12.141836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 18/31] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:11 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1280 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:12.268982 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-bd0b28fc-4e52-431d-9106-5bb6fd2b3138 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:12.283376 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-bd0b28fc-4e52-431d-9106-5bb6fd2b3138 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1215 microversion: 2.1 time: 0.306614 Aug 05 15:31:12.283376 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 14/32] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:11 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:13.159526 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:13.167009 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:13.237549 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:13.237549 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:13.237549 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:13.237549 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:13.238970 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:13.238970 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:13.311824 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4e3f8e18-6a76-4f8a-97ee-cfb444bfa6f9 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:13.312858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4e3f8e18-6a76-4f8a-97ee-cfb444bfa6f9 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:13.339557 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:13.350863 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7e521599-02cb-4c6f-a797-b30098b2e6c2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1280 microversion: 2.1 time: 0.204119 Aug 05 15:31:13.386037 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 19/33] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:13 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1280 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:13.513869 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4e3f8e18-6a76-4f8a-97ee-cfb444bfa6f9 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:13.526042 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4e3f8e18-6a76-4f8a-97ee-cfb444bfa6f9 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1215 microversion: 2.1 time: 0.218598 Aug 05 15:31:13.528865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 15/34] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:13 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:14.392434 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:14.393799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:14.409687 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=4 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:14.418925 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:14.419454 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:14.419889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:14.427727 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:14.428254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:14.435177 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:14.556923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:14.559072 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:14.592125 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:14.596855 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:14.600309 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:14.602638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:14.605911 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:14.614903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:14.983355 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:14.997441 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9247893d-1f1e-4f5d-8b52-63404e1885e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.609639 Aug 05 15:31:14.998322 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 20/35] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:14 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:15.325188 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:15.368410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-67c03713-3fe0-4299-9dba-a25b337bf442 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1267 microversion: 2.1 time: 0.811196 Aug 05 15:31:15.372176 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 16/36] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:14 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1267 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:16.019888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:16.020789 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:16.044587 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:16.045037 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:16.045486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:16.054618 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:16.055171 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:16.055818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:16.394443 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:16.395056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:16.406173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:16.406856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:16.407536 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:16.412382 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:16.412895 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:16.414555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:16.660411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:16.676176 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f1744ce1-2280-4556-af79-14ca797a0fa4 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1273 microversion: 2.1 time: 0.286126 Aug 05 15:31:16.680904 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 17/37] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:16 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:17.095961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:17.112507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d3ee8194-c243-48a4-b311-fa20405f903e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 1.096447 Aug 05 15:31:17.135578 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 21/38] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:16 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:17.708169 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:17.708169 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:17.726408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:17.729479 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:17.730125 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:17.731034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:17.732756 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:17.735440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:18.141581 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:18.143057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:18.152361 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:18.153133 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:18.153809 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:18.155858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:18.156588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:18.157244 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:18.202216 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:18.228422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9596ef0f-25e6-4977-8a7e-5d1e2ebfd74e tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1273 microversion: 2.1 time: 0.519563 Aug 05 15:31:18.228422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 18/39] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:17 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1273 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:19.035234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1525274023", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5556c147-7063-4e54-b1ad-a45bb656fda4"}], "security_groups": [{"name": "tempest-securitygroup--1837971509"}], "key_name": "tempest-keypair-506535949", "user_data": "}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:19.502429 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:19.512129 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-430209e6-47c1-432c-a193-fa4d746e99ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 1.375777 Aug 05 15:31:19.518201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 22/40] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:18 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:19.524603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:19.530732 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:19.548891 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:19.552845 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:19.553508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:19.554482 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:19.555177 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:19.556685 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:19.633049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] validate_networks() for [('5556c147-7063-4e54-b1ad-a45bb656fda4', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:31:19.831345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:19.846741 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0a8570c4-5a0e-4665-b789-e3f8c23fe3bb tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1273 microversion: 2.1 time: 0.327166 Aug 05 15:31:19.862678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 23/41] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:19 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:20.131209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-6bbd52f9-386f-4803-9ea3-cd85781cc844 req-4ff0d1bd-f946-4adc-9cad-336600f929e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eaf6904-d36e-48d4-9d13-cd73e2e9af47", "tag": "9a97ceb0-7729-4faa-9ff4-2bacbdbf1823"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:20.143312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=8 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:20.166468 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-6bbd52f9-386f-4803-9ea3-cd85781cc844 req-4ff0d1bd-f946-4adc-9cad-336600f929e8 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:20.167744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-6bbd52f9-386f-4803-9ea3-cd85781cc844 req-4ff0d1bd-f946-4adc-9cad-336600f929e8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:20.168470 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-6bbd52f9-386f-4803-9ea3-cd85781cc844 req-4ff0d1bd-f946-4adc-9cad-336600f929e8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:20.196003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-6bbd52f9-386f-4803-9ea3-cd85781cc844 req-4ff0d1bd-f946-4adc-9cad-336600f929e8 service nova] Creating event network-changed:9a97ceb0-7729-4faa-9ff4-2bacbdbf1823 for instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 on hv-cinder-84989 Aug 05 15:31:20.197594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-6bbd52f9-386f-4803-9ea3-cd85781cc844 req-4ff0d1bd-f946-4adc-9cad-336600f929e8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 15:31:20.198292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-6bbd52f9-386f-4803-9ea3-cd85781cc844 req-4ff0d1bd-f946-4adc-9cad-336600f929e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 15:31:20.199792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:20.200662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:20.201361 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:20.202364 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:20.202963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:20.203821 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:20.214493 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.compute.rpcapi [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 15:31:20.215914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] Releasing lock "compute-rpcapi-router" {{(pid=118723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 15:31:20.264724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6a209519-8c1a-4179-ba17-76cf226a5da3 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.400398 Aug 05 15:31:20.267746 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 24/42] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:20.543344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:20.544201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:20.559749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:20.562798 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:20.563984 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:20.575286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:20.576285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:20.578651 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:21.184663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=20 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:21.283607 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:21.536619 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:21.556436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e9fa938a-4fd7-4fd1-97a8-704b7f5b2f76 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 1.019268 Aug 05 15:31:21.559121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 25/43] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:20 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:21.574529 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:21.576350 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:21.597680 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:21.598528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:21.599211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:21.612589 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:21.615814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:21.617962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:22.126354 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:31:22.127054 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:31:22.127677 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:31:22.128266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:31:22.128854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:31:22.146562 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:22.147269 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:22.147856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:22.148769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:22.149374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:22.149970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:22.183903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Getting quotas for project f9776de9e6d341fdbf7ac4fa70b994aa. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:31:22.197442 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Getting quotas for user 04e80222936d4427909414a78e1dc489 and project f9776de9e6d341fdbf7ac4fa70b994aa. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:31:22.212137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:31:22.214602 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:31:22.247474 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:22.259609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ecb1a972-7eb1-489d-b8f6-c534b5cbe0ee tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.698586 Aug 05 15:31:22.260227 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 26/44] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:21 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:22.403844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-81d3e4dd-3c19-4237-8d59-77cc6d245f8c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.374332 Aug 05 15:31:22.410472 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 19/45] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:31:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 3382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:31:22.435817 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1156902613", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c44331f6-946f-4f51-8016-9a872c1f5969"}], "security_groups": [{"name": "tempest-securitygroup--1560428549"}], "key_name": "tempest-keypair-1204001639", "user_data": "}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:22.796899 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-c32ad764-e134-45ca-8d39-f58f94598f38 req-e3090435-8300-4419-8f18-c2508cb1b253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea1d385-2084-4d85-b55b-b3f0f3c55cb0", "tag": "81f5f43f-6504-4380-9838-2b4d5f79d684"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:22.823417 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c32ad764-e134-45ca-8d39-f58f94598f38 req-e3090435-8300-4419-8f18-c2508cb1b253 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:22.823957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c32ad764-e134-45ca-8d39-f58f94598f38 req-e3090435-8300-4419-8f18-c2508cb1b253 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:22.834249 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c32ad764-e134-45ca-8d39-f58f94598f38 req-e3090435-8300-4419-8f18-c2508cb1b253 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:22.852211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-c32ad764-e134-45ca-8d39-f58f94598f38 req-e3090435-8300-4419-8f18-c2508cb1b253 service nova] Creating event network-changed:81f5f43f-6504-4380-9838-2b4d5f79d684 for instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 on hv-cinder-84989 Aug 05 15:31:22.867647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-c32ad764-e134-45ca-8d39-f58f94598f38 req-e3090435-8300-4419-8f18-c2508cb1b253 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.603737 Aug 05 15:31:22.868553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 27/46] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:22.880310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ed15eef3-5e0e-4bfd-96f1-0b177a98c915 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:22.881233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ed15eef3-5e0e-4bfd-96f1-0b177a98c915 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:23.047605 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ed15eef3-5e0e-4bfd-96f1-0b177a98c915 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:23.067522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] validate_networks() for [('c44331f6-946f-4f51-8016-9a872c1f5969', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:31:23.087998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ed15eef3-5e0e-4bfd-96f1-0b177a98c915 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1237 microversion: 2.1 time: 0.217749 Aug 05 15:31:23.093951 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 28/47] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:22 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1237 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:23.100588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:23.102824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:23.113562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:23.118211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:23.118211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:23.118211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:23.118211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:23.118579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:23.799880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:23.809741 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6dbcdc36-db06-419f-b252-23bd9c985022 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.714607 Aug 05 15:31:23.855562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 29/48] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:23 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:23.877123 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:23.880921 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:23.890296 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:23.891710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:23.892393 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:23.897739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:23.897739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:23.897739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:24.486234 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:24.500493 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3a14c091-a695-4f13-8b2d-dcb39fada465 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.641301 Aug 05 15:31:24.501744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 30/49] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:23 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:24.516387 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-a90fe56d-35ac-473c-8fa8-6b500fd446e2 req-3a7481c6-a60d-47cd-84a0-eeb5ec23c9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6fc8045-3334-4a65-8f0c-abb0fccd473e", "tag": "28c81c6f-0f04-42c8-9ebc-2615897dd265"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:24.543600 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a90fe56d-35ac-473c-8fa8-6b500fd446e2 req-3a7481c6-a60d-47cd-84a0-eeb5ec23c9ad service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:24.543904 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a90fe56d-35ac-473c-8fa8-6b500fd446e2 req-3a7481c6-a60d-47cd-84a0-eeb5ec23c9ad service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:24.545115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a90fe56d-35ac-473c-8fa8-6b500fd446e2 req-3a7481c6-a60d-47cd-84a0-eeb5ec23c9ad service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:24.562937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-a90fe56d-35ac-473c-8fa8-6b500fd446e2 req-3a7481c6-a60d-47cd-84a0-eeb5ec23c9ad service nova] Creating event network-changed:28c81c6f-0f04-42c8-9ebc-2615897dd265 for instance b6fc8045-3334-4a65-8f0c-abb0fccd473e on hv-cinder-84989 Aug 05 15:31:24.575769 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-a90fe56d-35ac-473c-8fa8-6b500fd446e2 req-3a7481c6-a60d-47cd-84a0-eeb5ec23c9ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071814 Aug 05 15:31:24.578917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 31/50] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:24.587867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:24.588801 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:24.596286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:24.596959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:24.597394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:24.598269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:24.598871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:24.599486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:24.643698 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:31:24.644351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:31:24.644611 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:31:24.645020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:31:24.645429 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:31:24.647129 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:24.657338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:24.657852 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:24.663580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:24.668652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:24.677474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:24.677474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:24.763866 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Getting quotas for project 648f7ac8fb934441b6782d00d0b5ef10. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:31:24.780950 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Getting quotas for user d36b38a6e2d34c41b827ff6db9742332 and project 648f7ac8fb934441b6782d00d0b5ef10. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:31:24.815647 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:31:24.818228 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:31:25.050316 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7b56c89a-3910-4c35-85ed-74af2c81bc37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.638230 Aug 05 15:31:25.053305 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 20/51] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Aug 5 15:31:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 15:31:25.068464 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:25.069683 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:25.082664 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:25.083708 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:25.084506 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:25.085477 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:25.086165 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:25.086867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:25.224908 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:25.242281 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e3312597-d907-46d5-9f9d-9a21031e0f5d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1233 microversion: 2.1 time: 0.656925 Aug 05 15:31:25.259678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 32/52] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:24 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1233 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:25.264095 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-eaa43eb7-9fb7-4ead-8e7c-cc1b4f2bd6e7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:25.265680 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-eaa43eb7-9fb7-4ead-8e7c-cc1b4f2bd6e7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:25.440631 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-eaa43eb7-9fb7-4ead-8e7c-cc1b4f2bd6e7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:25.453722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-eaa43eb7-9fb7-4ead-8e7c-cc1b4f2bd6e7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:25.461374 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-eaa43eb7-9fb7-4ead-8e7c-cc1b4f2bd6e7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:25.468241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-eaa43eb7-9fb7-4ead-8e7c-cc1b4f2bd6e7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1282 microversion: 2.20 time: 0.217196 Aug 05 15:31:25.471924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 33/53] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:25 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:25.527243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:25.528508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:25.539198 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:25.540012 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:25.540587 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:25.541414 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:25.542101 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:25.542738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:25.746996 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:25.763032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-27551a7b-8de6-4cc0-b22b-132586495cdf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.700980 Aug 05 15:31:25.763909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 21/54] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:25 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:26.270210 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:26.271120 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:26.286551 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:26.291890 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:26.293028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:26.295106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:26.295903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:26.296886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:26.301777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:26.314404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e812b224-2708-4628-8eef-c60dc0d0388b tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.789099 Aug 05 15:31:26.317092 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 34/55] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:25 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:26.436239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:26.445903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-53b3b0a5-622c-4e0a-9eb5-daccffcaea7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1307 microversion: 2.1 time: 0.180976 Aug 05 15:31:26.447182 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 22/56] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:26 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:26.497762 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9137178f-6998-4040-9c51-8140bb237132 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:26.498379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9137178f-6998-4040-9c51-8140bb237132 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:26.571497 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9137178f-6998-4040-9c51-8140bb237132 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:26.584956 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9137178f-6998-4040-9c51-8140bb237132 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:26.586826 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9137178f-6998-4040-9c51-8140bb237132 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:26.588141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9137178f-6998-4040-9c51-8140bb237132 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1282 microversion: 2.20 time: 0.094631 Aug 05 15:31:26.589153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 35/57] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:26 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:26.789563 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:26.789563 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:26.792422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:26.792914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:26.793358 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:26.794055 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:26.794508 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:26.794944 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:27.001041 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:27.015326 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e41a43c0-b4b9-4cf8-829f-729698a141a8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.231705 Aug 05 15:31:27.018590 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 23/58] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:26 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:27.334974 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:27.335591 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:27.341689 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:27.342173 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:27.342610 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:27.343301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:27.343748 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:27.344200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:27.487531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:27.488441 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:27.501245 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:27.505370 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:27.505370 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:27.505370 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:27.505370 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:27.505748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:27.510914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:27.526639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7bd0556a-3a9e-420a-a9f6-1127a8fdcc2d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.195450 Aug 05 15:31:27.527754 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 36/59] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:27 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:27.615685 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:27.620016 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:27.633462 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:27.639336 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:27.639794 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:27.641909 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:27.642384 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:27.642877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:27.787989 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:27.789774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:27.802313 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7822963b-6610-4cbd-a650-0bfed173ba7c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.319092 Aug 05 15:31:27.803652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 24/60] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:27 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:27.809312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:27.810930 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:27.812090 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-57d05e3b-59e1-4ad2-b2ca-5d3d8b4fddfc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1286 microversion: 2.20 time: 0.202312 Aug 05 15:31:27.812650 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 37/61] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:27 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:28.038710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:28.039742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:28.046658 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:28.047402 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:28.047921 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:28.048750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:28.049331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:28.049828 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:28.205838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:28.213300 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d5314b86-3ecb-44b7-8356-b3eb4f9381a0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.178927 Aug 05 15:31:28.213847 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 25/62] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:28 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:28.552172 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:28.552887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:28.559177 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:28.559744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:28.560287 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:28.561055 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:28.561674 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:28.562104 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:28.700390 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:28.708035 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-dcd11924-281f-47e0-b2aa-a4b3db4b98c2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.159839 Aug 05 15:31:28.708632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 38/63] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:28 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:28.822641 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:28.823331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:28.825503 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:28.831985 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:28.832817 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:28.833451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:28.834356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:28.835203 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:28.835812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:28.843218 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:28.844572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:28.875167 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:28.875677 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:28.880304 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:28.881176 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:28.881658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:28.883925 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:28.997368 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:29.014536 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:29.024645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:29.028354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ed5696e6-929f-4a3a-8642-21a49be4a4b4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1286 microversion: 2.20 time: 0.197038 Aug 05 15:31:29.031255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 39/64] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:28 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:31:29.078297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:29.089991 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-32327ea8-69a6-4a0f-b609-6e830a77fa0b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.270721 Aug 05 15:31:29.106356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 26/65] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:28 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:29.234149 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:29.234848 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:29.241377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:29.242201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:29.242702 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:29.243451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:29.243969 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:29.244479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:29.500018 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:29.510499 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9bdccdda-8c55-4aac-8d55-a9f30a15dfc2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.280129 Aug 05 15:31:29.511224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 40/66] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:29 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:29.733429 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:29.734139 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:29.752652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:29.753141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:29.753574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:29.754272 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:29.754722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:29.755144 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:29.959607 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:29.967195 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-bf1d8009-bacb-4af9-98f7-850c392f5b27 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.242019 Aug 05 15:31:29.967755 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 27/67] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:29 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:30.055184 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:30.056445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:30.066044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.066833 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.067275 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.067977 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.068618 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.069098 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.111685 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:30.113565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:30.123416 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.124864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.125296 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.127248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.128630 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.131123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.194494 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:30.217757 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:30.219254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:30.227309 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-134f5fc1-76f6-4ac6-a9a5-968440b71b47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1334 microversion: 2.20 time: 0.169501 Aug 05 15:31:30.230805 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 41/68] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:30 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1334 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:30.314946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:30.323459 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d80938d8-b37d-40ce-aef2-f0bd91ed7d82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.216491 Aug 05 15:31:30.324424 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 28/69] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:30 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:30.533060 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:30.533942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:30.554368 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:30.556482 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.559790 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.564324 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.565300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.565776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.566216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.729209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:30.737847 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2ff06daf-9e17-4c4b-afc7-a62b5c7dd689 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.209957 Aug 05 15:31:30.738431 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 42/70] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:30 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:30.796293 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-31d56bd8-88db-4674-b40d-ff6f9611ac5c req-df408343-8f4b-4f61-91e5-4f03540055e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12163066-5037-46d7-8e66-c900aead6e69", "tag": "3bde49ef-58cd-4efe-9d08-24840f0c6502"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:30.810690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-31d56bd8-88db-4674-b40d-ff6f9611ac5c req-df408343-8f4b-4f61-91e5-4f03540055e7 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.811309 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-31d56bd8-88db-4674-b40d-ff6f9611ac5c req-df408343-8f4b-4f61-91e5-4f03540055e7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.811894 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-31d56bd8-88db-4674-b40d-ff6f9611ac5c req-df408343-8f4b-4f61-91e5-4f03540055e7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.832786 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-31d56bd8-88db-4674-b40d-ff6f9611ac5c req-df408343-8f4b-4f61-91e5-4f03540055e7 service nova] Creating event network-changed:3bde49ef-58cd-4efe-9d08-24840f0c6502 for instance 12163066-5037-46d7-8e66-c900aead6e69 on hv-cinder-84989 Aug 05 15:31:30.833313 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-31d56bd8-88db-4674-b40d-ff6f9611ac5c req-df408343-8f4b-4f61-91e5-4f03540055e7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 15:31:30.833864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-31d56bd8-88db-4674-b40d-ff6f9611ac5c req-df408343-8f4b-4f61-91e5-4f03540055e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 15:31:30.834887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.835522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.836116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.837009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.837459 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.837877 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.847415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.compute.rpcapi [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 15:31:30.848323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] Releasing lock "compute-rpcapi-router" {{(pid=118722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 15:31:30.864838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7208e1f9-4374-460a-9af1-1180c5f1e7eb None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072516 Aug 05 15:31:30.865663 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 29/71] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:30.988111 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:30.988573 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:30.995456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.996185 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:30.996861 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:30.997915 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:30.998431 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:31.003339 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:31.186709 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:31.196181 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9a93e6cd-c151-4364-99c8-bea1ed4f5ce5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.212126 Aug 05 15:31:31.199122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 43/72] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:30 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:31.253894 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:31.254706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:31.261370 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:31.262408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:31.263047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:31.264050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:31.264657 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:31.265264 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:31.349716 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:31.351661 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:31.361957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:31.363805 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:31.364608 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:31.365560 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:31.366222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:31.367633 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:31.421212 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:31.436620 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:31.456599 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:31.463592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5089d678-38a9-4c9d-83f9-5de32f97cdfa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1340 microversion: 2.20 time: 0.211396 Aug 05 15:31:31.464520 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 30/73] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:31 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1340 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:31.663456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:31.694075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8aad361a-3c5c-4ac5-a5b6-f700dc935225 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.348999 Aug 05 15:31:31.695059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 44/74] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:31 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:31.764922 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:31.765623 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:31.779711 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:31.780245 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:31.780692 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:31.781737 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:31.782862 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:31.783302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:31.791561 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=83 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:31.929951 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:31.938009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9a9aa739-4f98-454d-aaf1-b85a3cb7766d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.181168 Aug 05 15:31:31.948585 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 31/75] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:31 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:32.013204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-a2f4e6e4-008d-4edf-a1b1-b08534e7b373 req-481668f9-3878-4b9d-97ba-3eed94023e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eaf6904-d36e-48d4-9d13-cd73e2e9af47", "name": "network-vif-plugged", "status": "completed", "tag": "9a97ceb0-7729-4faa-9ff4-2bacbdbf1823"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:32.027551 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a2f4e6e4-008d-4edf-a1b1-b08534e7b373 req-481668f9-3878-4b9d-97ba-3eed94023e89 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.028053 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a2f4e6e4-008d-4edf-a1b1-b08534e7b373 req-481668f9-3878-4b9d-97ba-3eed94023e89 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.028491 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a2f4e6e4-008d-4edf-a1b1-b08534e7b373 req-481668f9-3878-4b9d-97ba-3eed94023e89 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:32.042232 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-a2f4e6e4-008d-4edf-a1b1-b08534e7b373 req-481668f9-3878-4b9d-97ba-3eed94023e89 service nova] Creating event network-vif-plugged:9a97ceb0-7729-4faa-9ff4-2bacbdbf1823 for instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 on hv-cinder-84989 Aug 05 15:31:32.047318 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-a2f4e6e4-008d-4edf-a1b1-b08534e7b373 req-481668f9-3878-4b9d-97ba-3eed94023e89 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088971 Aug 05 15:31:32.049030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 45/76] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:32.220166 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:32.220782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:32.226804 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.227282 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.227716 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:32.228433 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.228884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.229338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:32.379981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:32.394567 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a6984111-b007-4a87-aae1-6506df6865d5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.175473 Aug 05 15:31:32.395427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 32/77] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:32 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:32.491831 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:32.492621 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:32.499016 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.499485 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.499921 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:32.500629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.501160 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.501613 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:32.569138 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:32.580803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:32.582457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:32.583614 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-cd3bb8e9-110d-4f6c-9649-cc966ccc2198 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1340 microversion: 2.20 time: 0.096776 Aug 05 15:31:32.584255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 46/78] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:32 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:32.716900 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:32.717422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:32.724032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.724539 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.724972 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:32.726033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.726485 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.726910 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:32.964857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:32.964857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:32.971275 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.972219 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.972600 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:32.973301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:32.973752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:32.974174 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:33.050589 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:33.059465 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-14071cfa-540c-4653-848a-dd589ca76aed tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.345060 Aug 05 15:31:33.073931 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 33/79] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:32 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:33.252732 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:33.263408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-28afcfaf-5cc6-4a99-adeb-0eb373963053 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.307389 Aug 05 15:31:33.264388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 47/80] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:32 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:33.415404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:33.416212 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:33.422479 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:33.425664 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:33.425664 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:33.425664 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:33.428482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:33.429489 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:33.581854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:33.589395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-19327143-1a49-4762-bfef-5fd8c828c897 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.178004 Aug 05 15:31:33.593661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 34/81] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:33 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:33.608267 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:33.609829 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:33.617064 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:33.617901 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:33.618526 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:33.621811 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:33.621811 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:33.621811 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:33.773018 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:33.782453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:33.784913 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:33.786057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0ace06bc-efa0-44c4-82df-5bfb2d575884 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.181873 Aug 05 15:31:33.788621 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 48/82] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:33 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:34.073190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-6ebe8af4-6a03-41aa-8905-883bd3d4693f req-56de073b-0efd-4819-bf9b-6933ec3c3e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea1d385-2084-4d85-b55b-b3f0f3c55cb0", "name": "network-vif-plugged", "status": "completed", "tag": "81f5f43f-6504-4380-9838-2b4d5f79d684"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:34.085643 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6ebe8af4-6a03-41aa-8905-883bd3d4693f req-56de073b-0efd-4819-bf9b-6933ec3c3e40 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.086472 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6ebe8af4-6a03-41aa-8905-883bd3d4693f req-56de073b-0efd-4819-bf9b-6933ec3c3e40 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.087152 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6ebe8af4-6a03-41aa-8905-883bd3d4693f req-56de073b-0efd-4819-bf9b-6933ec3c3e40 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.090966 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:34.091428 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:34.101697 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-6ebe8af4-6a03-41aa-8905-883bd3d4693f req-56de073b-0efd-4819-bf9b-6933ec3c3e40 service nova] Creating event network-vif-plugged:81f5f43f-6504-4380-9838-2b4d5f79d684 for instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 on hv-cinder-84989 Aug 05 15:31:34.105224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.105506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.107108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.107811 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.107912 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-6ebe8af4-6a03-41aa-8905-883bd3d4693f req-56de073b-0efd-4819-bf9b-6933ec3c3e40 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038897 Aug 05 15:31:34.108450 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.108887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.108992 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 35/83] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:34.279467 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:34.305843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ffe6251e-8c56-48c1-b5bc-221f28bccc8b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.209106 Aug 05 15:31:34.306835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:34.306835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:34.306979 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 49/84] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:34 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:34.307047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.307047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.307047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.307047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.307294 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.307294 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.473681 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:34.485228 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4df066b1-dd63-474e-ba5e-dab3bee65f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.195608 Aug 05 15:31:34.486205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 36/85] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:34 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:34.609169 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:34.609790 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:34.634960 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.635466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.636301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.637476 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.639770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.640339 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.772241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-db2e9715-398c-41c5-9c6e-d092f453a57b req-4e7c2369-ec7c-433d-bde4-39d84915315a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c377a731-4e6f-47c0-96f5-1b3e2237897d", "tag": "a7e56405-70bc-42da-933f-8a3780bd6a0f"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:34.791984 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-db2e9715-398c-41c5-9c6e-d092f453a57b req-4e7c2369-ec7c-433d-bde4-39d84915315a service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.793483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-db2e9715-398c-41c5-9c6e-d092f453a57b req-4e7c2369-ec7c-433d-bde4-39d84915315a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.794446 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-db2e9715-398c-41c5-9c6e-d092f453a57b req-4e7c2369-ec7c-433d-bde4-39d84915315a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.799793 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=26 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:34.816055 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-db2e9715-398c-41c5-9c6e-d092f453a57b req-4e7c2369-ec7c-433d-bde4-39d84915315a service nova] Creating event network-changed:a7e56405-70bc-42da-933f-8a3780bd6a0f for instance c377a731-4e6f-47c0-96f5-1b3e2237897d on hv-cinder-84989 Aug 05 15:31:34.823932 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-db2e9715-398c-41c5-9c6e-d092f453a57b req-4e7c2369-ec7c-433d-bde4-39d84915315a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058670 Aug 05 15:31:34.825865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 37/86] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:31:34.831601 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:34.836520 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:34.840409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-89ebe4ad-4e77-4668-820d-2a3dfe8f3f38 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.234960 Aug 05 15:31:34.841353 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 50/87] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:34 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:34.853397 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:34.863292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.863958 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.864588 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:34.865558 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:34.866025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:34.866719 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:35.011699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:35.023438 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:35.025124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:35.026578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-57c2d97c-264c-4613-b999-9ccb04c45da9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.199092 Aug 05 15:31:35.037904 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 38/88] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:34 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:35.324771 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:35.324771 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:35.330387 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:35.330948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:35.331486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:35.332312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:35.332890 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:35.333486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:35.479813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:35.483445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:35.488534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c7dab54b-e7bb-4d82-be76-08a3e2dd265c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.173108 Aug 05 15:31:35.489116 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 51/89] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:35 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:35.509830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:35.510466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:35.516356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:35.516849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:35.517297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:35.517983 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:35.518434 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:35.518857 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:35.648181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:35.657803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ed7bdac8-cc83-4f22-a5b7-8d6ccb159711 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.151596 Aug 05 15:31:35.658608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 39/90] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:35 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:35.871626 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:35.872178 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:35.878924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:35.879662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:35.880465 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:35.881488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:35.882305 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:35.883102 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:36.043051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:36.051897 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:36.052667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:36.052786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-80d0a450-1b26-471e-88cb-f90f1c90f52d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.184662 Aug 05 15:31:36.053658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 52/91] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:35 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:36.060411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:36.062808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:36.063588 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:36.064362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:36.064987 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:36.065412 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:36.124828 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-f605491d-4ce7-4949-affb-71002545ceaf req-8889cc54-cde0-4b82-95c1-d14863c03589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fc8045-3334-4a65-8f0c-abb0fccd473e", "name": "network-vif-plugged", "status": "completed", "tag": "28c81c6f-0f04-42c8-9ebc-2615897dd265"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:36.136527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-f605491d-4ce7-4949-affb-71002545ceaf req-8889cc54-cde0-4b82-95c1-d14863c03589 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:36.137065 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-f605491d-4ce7-4949-affb-71002545ceaf req-8889cc54-cde0-4b82-95c1-d14863c03589 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:36.137499 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-f605491d-4ce7-4949-affb-71002545ceaf req-8889cc54-cde0-4b82-95c1-d14863c03589 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:36.150772 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-f605491d-4ce7-4949-affb-71002545ceaf req-8889cc54-cde0-4b82-95c1-d14863c03589 service nova] Creating event network-vif-plugged:28c81c6f-0f04-42c8-9ebc-2615897dd265 for instance b6fc8045-3334-4a65-8f0c-abb0fccd473e on hv-cinder-84989 Aug 05 15:31:36.156080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-f605491d-4ce7-4949-affb-71002545ceaf req-8889cc54-cde0-4b82-95c1-d14863c03589 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Aug 05 15:31:36.156679 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 53/92] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:31:36.198779 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:36.207317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:36.208924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:36.210030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e218b8c5-6ae0-4b5b-b30b-046c0f17bcfe tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.164113 Aug 05 15:31:36.210589 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 40/93] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:36 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:36.521616 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:36.522313 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:36.529401 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:36.530032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:36.530473 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:36.531163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:36.531822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:36.532310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:36.575788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=6 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:36.678692 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:36.679335 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:36.686344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:36.688552 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:36.695032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:36.695573 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:36.696346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:36.696816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:36.697242 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:36.699551 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fcf241f9-58bb-40ea-af91-72a9f5affb6a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.183541 Aug 05 15:31:36.701204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 54/94] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:36 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:36.873794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:36.881716 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b01c7f29-fc67-4e6a-a42b-71659e897944 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.206766 Aug 05 15:31:36.882288 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 41/95] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:36 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:37.073517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:37.074121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:37.080237 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:37.080709 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:37.081138 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:37.081811 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:37.082258 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:37.082681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:37.232111 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:37.232334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:37.232960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:37.239534 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:37.240016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:37.240533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:37.240807 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-adf83233-6425-4598-a5d2-8d5128ac63d6 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.171257 Aug 05 15:31:37.241511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:37.241766 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 55/96] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:37 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:37.241976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:37.242379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:37.368961 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:37.376728 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:37.378219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:37.379328 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0c47cffa-e0b7-4baa-8ec6-c23f3418e705 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.150919 Aug 05 15:31:37.380295 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 42/97] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:37 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:31:37.722605 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:37.728609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:37.729697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:37.730181 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:37.730615 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:37.731932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:37.732571 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:37.732991 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:37.893519 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:37.901469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9b3c2588-c87b-4258-af7a-18e81b27d3ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.183837 Aug 05 15:31:37.902193 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 56/98] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:37 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:37.910091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:37.910773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:37.922325 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:37.923840 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:37.924879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:37.930371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:37.930371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:37.930371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:38.061191 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:38.069203 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f8accbeb-f6d0-48c4-bd22-978abd5e45a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.170267 Aug 05 15:31:38.069769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 43/99] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:37 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:38.262254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:38.262873 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:38.269032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:38.269524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:38.269967 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:38.270678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:38.271146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:38.273779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:38.401514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:38.402260 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:38.409524 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:38.410020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:38.410611 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:38.411500 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:38.411952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:38.412552 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:38.434139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:38.443172 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e62f48e6-5323-4bfd-a0b8-6a9d26471fa5 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.184681 Aug 05 15:31:38.444637 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 57/100] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:38 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:38.550716 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:38.558673 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:38.560213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:38.561315 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5d936e34-4d39-47b7-a877-e75d8352216c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.163809 Aug 05 15:31:38.561878 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 44/101] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:38 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:31:38.922205 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:38.922816 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:38.929546 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:38.930043 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:38.930465 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:38.931154 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:38.931611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:38.934678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:39.076527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:39.084423 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-116d6b6e-4e5a-4cc4-82e6-115b9bd881c5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.165900 Aug 05 15:31:39.085000 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 58/102] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:38 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:39.089443 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:39.090538 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:39.097228 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:39.097702 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:39.098130 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:39.098808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:39.099250 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:39.099741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:39.283686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:39.291188 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8a3a8dc4-68f0-427c-a094-d070fafb5604 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1322 microversion: 2.1 time: 0.205506 Aug 05 15:31:39.291751 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 45/103] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:39 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:39.463857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:39.465490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:39.472935 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:39.473419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:39.474092 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:39.474839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:39.475285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:39.475706 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:39.587048 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:39.588501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:39.596728 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:39.597746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:39.598361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:39.599217 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:39.599812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:39.600404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:39.620771 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:39.629756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4d21aa70-65b2-4143-bd57-9a1bc99d1725 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1315 microversion: 2.1 time: 0.170162 Aug 05 15:31:39.631344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 59/104] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:39 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:39.806895 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:39.830148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:39.835374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:39.837778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-289e9557-834e-4848-a9bd-982a1975d039 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.256540 Aug 05 15:31:39.840502 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 46/105] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:39 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:31:40.106046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:40.106625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:40.113144 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.113642 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.114063 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.114983 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.115598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.116028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.168621 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-d3df3bef-9595-46d6-8340-c0b44cc0968b req-98928710-b530-4816-9ea8-cf30ab9a0caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12163066-5037-46d7-8e66-c900aead6e69", "name": "network-vif-plugged", "status": "completed", "tag": "3bde49ef-58cd-4efe-9d08-24840f0c6502"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:40.194003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-d3df3bef-9595-46d6-8340-c0b44cc0968b req-98928710-b530-4816-9ea8-cf30ab9a0caf service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.196134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-d3df3bef-9595-46d6-8340-c0b44cc0968b req-98928710-b530-4816-9ea8-cf30ab9a0caf service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.196735 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-d3df3bef-9595-46d6-8340-c0b44cc0968b req-98928710-b530-4816-9ea8-cf30ab9a0caf service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.233360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-d3df3bef-9595-46d6-8340-c0b44cc0968b req-98928710-b530-4816-9ea8-cf30ab9a0caf service nova] Creating event network-vif-plugged:3bde49ef-58cd-4efe-9d08-24840f0c6502 for instance 12163066-5037-46d7-8e66-c900aead6e69 on hv-cinder-84989 Aug 05 15:31:40.240227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-d3df3bef-9595-46d6-8340-c0b44cc0968b req-98928710-b530-4816-9ea8-cf30ab9a0caf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075725 Aug 05 15:31:40.241577 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 47/106] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:31:40.317276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:40.320926 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:40.326366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.327011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.327635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.327764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:40.328468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.328923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.329389 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.337216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f4a6a11a-94d5-41bc-9220-12df0e2b41f8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.235104 Aug 05 15:31:40.337700 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 60/107] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:40 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:40.608279 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:40.618514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b9d22424-3541-44f6-9432-8cd9b882845e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1516 microversion: 2.1 time: 0.309227 Aug 05 15:31:40.628978 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 48/108] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:40 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:40.640601 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:40.646684 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:40.653647 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:40.656601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:40.664011 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.668139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.680126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.680126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.680126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.680126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.680592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.680592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.680592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.680592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.680981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.680981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.749468 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lazy-loading 'flavor' on Instance uuid 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:31:40.845591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=6 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:40.869332 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:40.871483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=100 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:40.877770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-66f9b0e5-dabf-40a6-adff-e6ef261dbfef tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1501 microversion: 2.1 time: 0.230562 Aug 05 15:31:40.878856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 49/109] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:40 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:40.883609 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:40.884441 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:40.890519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.891177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.892371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:40.893066 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:40.893516 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:40.894088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:41.075993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:41.085119 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:41.086609 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:41.087719 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-da0915c7-99d3-4b0c-86cb-31b460d02482 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.207749 Aug 05 15:31:41.088297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 50/110] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:40 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:41.130402 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-60377993-ebdf-4a08-ac81-572cfd95f381 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0/action" status: 200 len: 32 microversion: 2.1 time: 0.494252 Aug 05 15:31:41.136757 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 61/111] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:31:40 2022] POST /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0/action => generated 32 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 15:31:41.143754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:41.144569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:41.150699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:41.151398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:41.152056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:41.152861 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:41.153383 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:41.153875 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:41.291412 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:41.302711 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3b8c5916-17f0-402e-9b11-73cfe73e5192 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.164536 Aug 05 15:31:41.303784 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 51/112] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:41 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:41.358165 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:41.358933 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:41.366044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:41.366044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:41.366044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:41.366984 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:41.367433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:41.367854 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:41.518737 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:41.526394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9d436d54-f5d0-431c-8bc5-73eea16f6dab tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.172383 Aug 05 15:31:41.526963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 62/113] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:41 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:42.111280 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:42.111937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:42.118588 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:42.119073 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:42.119511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:42.120239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:42.120695 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:42.121154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:42.252652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:42.260475 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:42.261977 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:42.263075 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d67794a9-981f-40d8-94da-9a7e6f972926 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.156684 Aug 05 15:31:42.263625 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 52/114] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:42 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:42.330635 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:42.334206 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:42.337673 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:42.338389 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:42.338908 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:42.339782 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:42.340422 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:42.340853 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:42.478445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:42.486732 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-75e063e6-ec34-4680-94fe-65b9ae07e691 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.165679 Aug 05 15:31:42.487209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 63/115] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:42 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:42.549193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:42.549889 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:42.557291 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:42.557904 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:42.558352 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:42.559130 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:42.559659 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:42.560183 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:42.702424 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:42.710888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60736b56-9093-49bb-b842-a9840627fa7d"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:42.715211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:42.722520 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7deec5c6-afec-4589-92a9-e421262e37a2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1363 microversion: 2.1 time: 0.179158 Aug 05 15:31:42.723448 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 53/116] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:42 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:42.734617 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:42.735147 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:42.735629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:42.736311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:42.736913 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:42.737490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:43.286347 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:43.287057 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:43.293848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:43.294344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:43.294777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:43.295693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:43.296210 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:43.296645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:43.465605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:43.475274 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:43.476898 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:43.478815 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-788c5998-8565-4b10-b6b2-8532b026b680 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.197080 Aug 05 15:31:43.494560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 54/117] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:43 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:31:43.516316 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:43.518023 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:43.524036 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:43.524551 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:43.524983 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:43.525723 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:43.526138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:43.526562 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:43.682148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:43.692417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f06ef0c8-572e-46cf-8b91-38b6b29a7ea9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.179999 Aug 05 15:31:43.693146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 55/118] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:43 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:43.752298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:43.753010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:43.759183 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:43.759706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:43.760175 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:43.760871 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:43.761323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:43.761748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:43.872799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1e8fccd4-6ae6-4c6c-ad3b-3e92ffa2252a tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "POST /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.165631 Aug 05 15:31:43.873903 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 64/119] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:31:42 2022] POST /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:31:43.910850 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:43.925285 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-68c06d5e-b769-463b-add8-6f4cd77ae856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1550 microversion: 2.1 time: 0.177365 Aug 05 15:31:43.926265 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 56/120] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:43 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:43.961027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:43.961737 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:43.971251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:43.973657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:43.974224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:43.976186 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:43.977637 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:43.978175 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:44.109687 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ecf39076-8a8a-438e-b69f-da4997881f38 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153026 Aug 05 15:31:44.109687 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 65/121] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 15:31:43 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:44.520252 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:44.521518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:44.536635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:44.537393 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:44.537990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:44.539158 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:44.539774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:44.540242 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:44.722290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:44.723205 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:44.733819 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:44.734759 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:44.737817 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:44.738809 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:44.740479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:44.741871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:44.765624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:44.952881 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:44.962090 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:44.963605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:44.964832 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ba7041ca-d3c0-4edc-9238-b72b9640e2af tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.450720 Aug 05 15:31:44.977387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 57/122] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:44 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:44.980887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:44.992287 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8a2a8670-feb0-4296-b013-936f8bdedea0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.281895 Aug 05 15:31:44.993467 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 66/123] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:44 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:45.650942 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-a8a52ee7-802c-4577-906d-fd13ec6213e3 req-3ce0379b-3216-44aa-9cc9-2218a147c143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12163066-5037-46d7-8e66-c900aead6e69", "tag": "3bde49ef-58cd-4efe-9d08-24840f0c6502"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:45.662155 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-a8a52ee7-802c-4577-906d-fd13ec6213e3 req-3ce0379b-3216-44aa-9cc9-2218a147c143 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:45.664193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-a8a52ee7-802c-4577-906d-fd13ec6213e3 req-3ce0379b-3216-44aa-9cc9-2218a147c143 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:45.664193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-a8a52ee7-802c-4577-906d-fd13ec6213e3 req-3ce0379b-3216-44aa-9cc9-2218a147c143 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:45.675594 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-a8a52ee7-802c-4577-906d-fd13ec6213e3 req-3ce0379b-3216-44aa-9cc9-2218a147c143 service nova] Creating event network-changed:3bde49ef-58cd-4efe-9d08-24840f0c6502 for instance 12163066-5037-46d7-8e66-c900aead6e69 on hv-cinder-84989 Aug 05 15:31:45.681067 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-a8a52ee7-802c-4577-906d-fd13ec6213e3 req-3ce0379b-3216-44aa-9cc9-2218a147c143 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034163 Aug 05 15:31:45.681984 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 58/124] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:45.993060 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:45.993944 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:46.016955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:46.018365 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:46.025716 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:46.027325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:46.027985 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:46.029541 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:46.030206 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:46.030655 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:46.031147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:46.031548 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:46.032749 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:46.034074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:46.035959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:46.037621 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:46.275332 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:46.289361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-911f20d3-6410-4c86-98dc-db0cbb519f2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.279471 Aug 05 15:31:46.300464 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 59/125] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:46 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:31:46.314366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-83b020f1-75e3-4b6e-8070-7c16074ba2fb req-e1fb4db1-59b1-4310-83cd-4983d7d23913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c377a731-4e6f-47c0-96f5-1b3e2237897d", "name": "network-vif-plugged", "status": "completed", "tag": "a7e56405-70bc-42da-933f-8a3780bd6a0f"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:46.330022 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-83b020f1-75e3-4b6e-8070-7c16074ba2fb req-e1fb4db1-59b1-4310-83cd-4983d7d23913 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:46.330503 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-83b020f1-75e3-4b6e-8070-7c16074ba2fb req-e1fb4db1-59b1-4310-83cd-4983d7d23913 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:46.330918 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-83b020f1-75e3-4b6e-8070-7c16074ba2fb req-e1fb4db1-59b1-4310-83cd-4983d7d23913 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:46.332660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:46.341592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:46.343470 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:46.343923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-83b020f1-75e3-4b6e-8070-7c16074ba2fb req-e1fb4db1-59b1-4310-83cd-4983d7d23913 service nova] Creating event network-vif-plugged:a7e56405-70bc-42da-933f-8a3780bd6a0f for instance c377a731-4e6f-47c0-96f5-1b3e2237897d on hv-cinder-84989 Aug 05 15:31:46.345071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-78c1b51e-cf9b-48ed-885b-e94f038aa762 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.360971 Aug 05 15:31:46.346210 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 67/126] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:45 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:46.349198 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-83b020f1-75e3-4b6e-8070-7c16074ba2fb req-e1fb4db1-59b1-4310-83cd-4983d7d23913 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045956 Aug 05 15:31:46.350438 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 60/127] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:47.310350 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:47.310898 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:47.317614 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:47.318092 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:47.318524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:47.319203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:47.319652 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:47.320090 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:47.368461 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:47.369241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:47.382105 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:47.382608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:47.383049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:47.383756 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:47.384273 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:47.384703 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:47.540563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:47.549115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b6765d5b-e71b-4d1c-9ebe-65d046a4f426 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.242886 Aug 05 15:31:47.563097 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 68/128] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:47 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:47.687533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:47.704266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:47.707224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:47.709350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-339e0d34-0564-40af-b7a3-eb0c3ea5ab24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1408 microversion: 2.20 time: 0.344908 Aug 05 15:31:47.710681 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 61/129] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:47 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1408 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:31:48.570224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:48.570895 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:48.577890 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:48.578372 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:48.579462 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:48.580186 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:48.580644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:48.581073 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:48.727859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:48.736688 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:48.737289 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:48.744197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:48.744493 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-eeeb6692-142a-409a-add2-08e7a281f84c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.178172 Aug 05 15:31:48.744867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:48.745491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:48.745869 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 69/130] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:48 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:48.746249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:48.746766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:48.747253 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:48.907630 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:48.927491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:48.929044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:48.930622 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-069227d3-5273-4d63-b738-352e26a7dc52 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1600 microversion: 2.20 time: 0.198329 Aug 05 15:31:48.931242 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 62/131] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:31:48 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1600 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:31:48.957904 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:48.958505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:48.964656 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:48.965222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:48.965914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:48.966710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:48.967379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:48.967804 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:49.048179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2b316759-ec3b-455f-9d36-cda3f494520b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094790 Aug 05 15:31:49.048871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 70/132] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Aug 5 15:31:48 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:31:49.765663 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:49.767007 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:49.773381 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:49.773921 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:49.774358 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:49.775047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:49.775498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:49.775918 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:49.987008 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:49.994755 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ec21dd0d-cda9-4d0e-97fb-6119c89f0c8d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.232922 Aug 05 15:31:49.995293 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 63/133] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:49 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:50.558487 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-e62fd047-c438-47bd-8298-b5c6d3145aa0 req-24403763-b4b3-443c-b3ff-ac91d7608dea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c377a731-4e6f-47c0-96f5-1b3e2237897d", "tag": "a7e56405-70bc-42da-933f-8a3780bd6a0f"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:50.568308 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:50.569250 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e62fd047-c438-47bd-8298-b5c6d3145aa0 req-24403763-b4b3-443c-b3ff-ac91d7608dea service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:50.569724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e62fd047-c438-47bd-8298-b5c6d3145aa0 req-24403763-b4b3-443c-b3ff-ac91d7608dea service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:50.570331 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e62fd047-c438-47bd-8298-b5c6d3145aa0 req-24403763-b4b3-443c-b3ff-ac91d7608dea service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:50.581769 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-e62fd047-c438-47bd-8298-b5c6d3145aa0 req-24403763-b4b3-443c-b3ff-ac91d7608dea service nova] Creating event network-changed:a7e56405-70bc-42da-933f-8a3780bd6a0f for instance c377a731-4e6f-47c0-96f5-1b3e2237897d on hv-cinder-84989 Aug 05 15:31:50.586981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-e62fd047-c438-47bd-8298-b5c6d3145aa0 req-24403763-b4b3-443c-b3ff-ac91d7608dea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032663 Aug 05 15:31:50.587566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 71/134] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:31:51.017195 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:51.018331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:51.024900 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:51.025605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:51.026202 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:51.027089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:51.027701 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:51.028148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:51.181505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:51.191701 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-30056229-1494-4bd2-8600-91a0fde83b3a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.179201 Aug 05 15:31:51.194178 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 64/135] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:51 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:52.217589 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:52.218287 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:52.225622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:52.226105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:52.226546 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:52.227238 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:52.227691 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:52.228136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:52.374076 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:52.382103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8b1ef07b-331c-4f47-b663-81b2727c68bd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.170659 Aug 05 15:31:52.382661 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 72/136] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:52 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:53.402778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:53.403447 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:53.410294 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:53.410809 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:53.411268 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:53.411959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:53.413680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:53.413680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:53.549949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:53.557343 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-eb0644d1-dbca-47a8-89a5-8dfc578d3c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.158477 Aug 05 15:31:53.557902 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 65/137] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:53 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:54.507623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:54.508688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:54.515216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:54.516375 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:54.516819 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:54.517522 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:54.518109 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:54.518538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:54.544710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Going to try to terminate instance {{(pid=118723) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:31:54.581888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:54.583277 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:54.590053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:54.590587 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:54.591024 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:54.591715 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:54.592195 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:54.592814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:54.729379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:54.741836 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b1fda959-4186-4c80-8014-74df5d468027 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.167636 Aug 05 15:31:54.742377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 66/138] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:54 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:54.821369 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a0eb06ff-c7a2-4c1d-8797-62a26aad4d2f tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 204 len: 0 microversion: 2.1 time: 0.317246 Aug 05 15:31:54.822124 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 73/139] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:31:54 2022] DELETE /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:31:54.835348 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:54.835953 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:54.842002 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:54.842531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:54.843087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:54.844450 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:54.844997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:54.845411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:54.984421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:54.986665 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=100 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:31:54.993458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c271f22f-0584-4820-bca9-26f10f9a0ce1 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1553 microversion: 2.1 time: 0.162596 Aug 05 15:31:54.994024 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 67/140] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:54 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:55.764279 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:55.765482 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:55.773639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:55.773639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:55.776539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:55.776539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:55.776539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:55.776539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:55.931648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:55.947267 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5cb9c388-5ddd-467e-b7fd-43c06d3bb2b4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.187146 Aug 05 15:31:55.948088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 74/141] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:55 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:56.016412 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:56.016994 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:56.024982 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:56.025551 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:56.026035 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:56.026678 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:56.027136 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:56.027775 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:56.164289 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:56.174152 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-78c296f5-2e88-4be8-9814-18307eea8167 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1553 microversion: 2.1 time: 0.163155 Aug 05 15:31:56.174727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 68/142] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:56 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:56.971580 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:56.972256 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:56.978505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:56.978989 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:56.979424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:56.980151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:56.980609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:56.981037 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:57.163425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:57.170503 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a1dad6b7-6d31-4b05-94b9-b7202b4a7fa0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.203229 Aug 05 15:31:57.180245 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 75/143] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:56 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:57.196803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:57.197414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:57.204307 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:57.204980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:57.205591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:57.206456 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:57.207089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:57.207662 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:57.404591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:57.417829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e09b5bf4-81ae-4649-875c-3904ec837163 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1553 microversion: 2.1 time: 0.225233 Aug 05 15:31:57.418670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 69/144] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:57 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:58.199115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:58.199849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:58.207060 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:58.207573 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:58.208007 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:58.208738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:58.209249 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:58.209766 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:58.345347 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:58.353758 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-999ed737-2fd6-4405-ad80-c0cd1032c187 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.158664 Aug 05 15:31:58.354426 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 76/145] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:58 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:58.446320 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:58.446320 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:58.452848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:58.453357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:58.453784 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:58.454493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:58.454927 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:58.457730 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:58.604814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-57cb823c-6e89-4630-8d9e-f5777ac89473 req-b7fed89a-0a32-4424-976a-f80aadaaf9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fc8045-3334-4a65-8f0c-abb0fccd473e", "name": "network-vif-deleted", "tag": "28c81c6f-0f04-42c8-9ebc-2615897dd265"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:31:58.620945 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:58.653778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f8afc2a9-8110-4b11-8ea7-2bd8bee530b2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1511 microversion: 2.1 time: 0.202368 Aug 05 15:31:58.653778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 70/146] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:58 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:58.654392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-57cb823c-6e89-4630-8d9e-f5777ac89473 req-b7fed89a-0a32-4424-976a-f80aadaaf9fb service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:58.654392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-57cb823c-6e89-4630-8d9e-f5777ac89473 req-b7fed89a-0a32-4424-976a-f80aadaaf9fb service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:58.654392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-57cb823c-6e89-4630-8d9e-f5777ac89473 req-b7fed89a-0a32-4424-976a-f80aadaaf9fb service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:58.665550 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-57cb823c-6e89-4630-8d9e-f5777ac89473 req-b7fed89a-0a32-4424-976a-f80aadaaf9fb service nova] Creating event network-vif-deleted:28c81c6f-0f04-42c8-9ebc-2615897dd265 for instance b6fc8045-3334-4a65-8f0c-abb0fccd473e on hv-cinder-84989 Aug 05 15:31:58.677976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-57cb823c-6e89-4630-8d9e-f5777ac89473 req-b7fed89a-0a32-4424-976a-f80aadaaf9fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071277 Aug 05 15:31:58.678407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 77/147] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:31:59.379133 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:59.380243 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:59.389294 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:59.390904 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:59.391753 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:59.393131 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:59.394084 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:59.398352 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:59.529650 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:59.537916 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f2feedd7-4c1a-4a02-a3e0-5bdf6cc49d2c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.165471 Aug 05 15:31:59.538491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 71/148] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:59 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:31:59.663655 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:31:59.667274 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:31:59.670878 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:59.671907 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:59.672422 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:59.673130 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:59.673588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:59.674022 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:59.707376 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:31:59.707880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:31:59.708354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:31:59.708812 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lazy-loading 'fault' on Instance uuid b6fc8045-3334-4a65-8f0c-abb0fccd473e {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:31:59.763094 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:31:59.789698 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a5dd7efe-36ac-48e9-870b-a852edd69e06 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1351 microversion: 2.1 time: 0.130770 Aug 05 15:31:59.791570 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 78/149] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:31:59 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:00.558795 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:00.559394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:00.565388 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:00.565863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:00.566287 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:00.566963 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:00.567508 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:00.567877 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:00.702029 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:00.710100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-72b30c99-5c29-433b-9973-8246779f0f59 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.155135 Aug 05 15:32:00.726065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 72/150] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:00 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:00.810593 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:00.811204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:00.818137 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:00.818616 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:00.819050 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:00.819737 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:00.820225 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:00.820648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:00.855340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:00.855827 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:00.856309 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:00.856763 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lazy-loading 'fault' on Instance uuid b6fc8045-3334-4a65-8f0c-abb0fccd473e {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:32:00.899239 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:00.907188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d27ed083-97f3-438e-b7b7-e46a4997c210 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1351 microversion: 2.1 time: 0.100600 Aug 05 15:32:00.907762 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 79/151] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:00 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:01.730608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:01.731214 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:01.733110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=94 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:01.738536 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:01.739016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:01.739448 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:01.740151 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:01.740859 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:01.741281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:01.911860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:01.919329 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9e1960c3-5c04-42fe-9aba-f26f20d54739 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.192548 Aug 05 15:32:01.919952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 73/152] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:01 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:01.926574 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:01.927207 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:01.933650 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:01.934356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:01.934989 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:01.935761 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:01.936306 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:01.936820 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:01.971494 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:01.972532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:01.973136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:01.973590 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lazy-loading 'fault' on Instance uuid b6fc8045-3334-4a65-8f0c-abb0fccd473e {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:32:02.016866 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0882cb9bf4744feae298fb8f10cebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020b2f0e82d14211b286f1ac1e3823a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:02.024803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b948fa9e-f3a3-494a-8d56-8ea697ba2f9d tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 200 len: 1351 microversion: 2.1 time: 0.102013 Aug 05 15:32:02.025361 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 80/153] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:01 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:02.942742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:02.943281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:02.949174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:02.957691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:02.957691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:02.957691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:02.957691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:02.958109 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:03.048974 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:03.049715 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:03.056739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:03.057367 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:03.057943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:03.058862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:03.059405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:03.059934 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:03.078983 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] HTTP exception thrown: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.085918 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Request method failure captured: Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e HTTP/1.1 Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7Te58FYqnKHXdYhUjV8FopFcqhNTvoRO7GgyoW_Bdwp8v4y0eiotDnvQ5PqA8rovLVYZZCkTWgpSK8aBLt9PlXwDcx7FiZb0Ec3Yg-_LOv6MuR5eAlydokl4WHQjhSh75GPzXCwWMSTrYGrw1cD08PVPKHBoNCXBwsy1qtotTS9aEd0 Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 020b2f0e82d14211b286f1ac1e3823a9 Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:32:03.088572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_020b2f0e82d14211b286f1ac1e3823a9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/020b2f0e82d14211b286f1ac1e3823a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/020b2f0e82d14211b286f1ac1e3823a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/020b2f0e82d14211b286f1ac1e3823a9"}]}] Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 020b2f0e82d14211b286f1ac1e3823a9 Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-DeleteServersTestJSON-1224924960-project Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: b0882cb9bf4744feae298fb8f10cebeb Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-DeleteServersTestJSON-1224924960-project Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.090031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': 'b6fc8045-3334-4a65-8f0c-abb0fccd473e'} Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:32:03.090822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.092224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.093842 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Returning 404 to user: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:32:03.093842 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1c9a6035-ca3d-4490-92a1-e39e013da6e0 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 404 len: 111 microversion: 2.1 time: 0.046357 Aug 05 15:32:03.101187 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d3ce379c-fe43-4dde-9f74-9f7cb389d6c0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.162447 Aug 05 15:32:03.102232 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 74/154] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:02 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:03.104018 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 81/155] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:03 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:32:03.206968 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:03.209295 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:03.214969 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:03.215445 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:03.215876 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:03.216586 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:03.217030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:03.217628 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:03.262175 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] HTTP exception thrown: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Request method failure captured: Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e/os-volume_attachments HTTP/1.1 Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te58FYqnKHXdYhUjV8FopFcqhNTvoRO7GgyoW_Bdwp8v4y0eiotDnvQ5PqA8rovLVYZZCkTWgpSK8aBLt9PlXwDcx7FiZb0Ec3Yg-_LOv6MuR5eAlydokl4WHQjhSh75GPzXCwWMSTrYGrw1cD08PVPKHBoNCXBwsy1qtotTS9aEd0 Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 020b2f0e82d14211b286f1ac1e3823a9 Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:32:03.266248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_020b2f0e82d14211b286f1ac1e3823a9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/020b2f0e82d14211b286f1ac1e3823a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/020b2f0e82d14211b286f1ac1e3823a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/020b2f0e82d14211b286f1ac1e3823a9"}]}] Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 020b2f0e82d14211b286f1ac1e3823a9 Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-DeleteServersTestJSON-1224924960-project Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: b0882cb9bf4744feae298fb8f10cebeb Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-DeleteServersTestJSON-1224924960-project Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.267591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'server_id': 'b6fc8045-3334-4a65-8f0c-abb0fccd473e'} Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:32:03.268473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:03.269752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:03.270791 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Returning 404 to user: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:32:03.270791 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d26377c4-6140-41b0-8450-f2ffc4b6556c tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065176 Aug 05 15:32:03.270791 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 75/156] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:32:03 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:32:04.122629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:04.123270 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:04.130285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:04.130764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:04.131194 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:04.131875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:04.132351 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:04.132776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:04.153539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:04.265621 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:04.272885 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c17b3d34-a96a-4bbe-b543-515e9cc22242 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.154080 Aug 05 15:32:04.273457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 82/157] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:04 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:05.293824 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:05.294420 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:05.300998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:05.301470 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:05.301900 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:05.302572 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:05.303010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:05.303427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:05.431455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:05.439188 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2f0b65da-dec2-4016-8a0c-b78c7e2bfa8a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.149493 Aug 05 15:32:05.439744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 76/158] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:05 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:06.460015 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:06.460551 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:06.466973 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:06.467539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:06.467972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:06.468676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:06.469125 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:06.472354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:06.626188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:06.634902 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d4423a3a-9b43-45b8-9de1-353274eab8bf tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.178659 Aug 05 15:32:06.635540 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 83/159] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:06 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:06.863083 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:06.863797 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:06.870220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:06.870709 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:06.871142 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:06.872137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:06.872435 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:06.872854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:06.886767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] HTTP exception thrown: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Request method failure captured: Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: DELETE /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e HTTP/1.1 Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te58FYqnKHXdYhUjV8FopFcqhNTvoRO7GgyoW_Bdwp8v4y0eiotDnvQ5PqA8rovLVYZZCkTWgpSK8aBLt9PlXwDcx7FiZb0Ec3Yg-_LOv6MuR5eAlydokl4WHQjhSh75GPzXCwWMSTrYGrw1cD08PVPKHBoNCXBwsy1qtotTS9aEd0 Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 020b2f0e82d14211b286f1ac1e3823a9 Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:32:06.888939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_020b2f0e82d14211b286f1ac1e3823a9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/020b2f0e82d14211b286f1ac1e3823a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/020b2f0e82d14211b286f1ac1e3823a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/020b2f0e82d14211b286f1ac1e3823a9"}]}] Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 020b2f0e82d14211b286f1ac1e3823a9 Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-DeleteServersTestJSON-1224924960-project Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: b0882cb9bf4744feae298fb8f10cebeb Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-DeleteServersTestJSON-1224924960-project Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.890234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'b6fc8045-3334-4a65-8f0c-abb0fccd473e'} Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:32:06.890976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.892777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.899117 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Returning 404 to user: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:32:06.899117 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b66526aa-b76f-42a4-bcc4-8490a8a21ea2 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 404 len: 111 microversion: 2.1 time: 0.031961 Aug 05 15:32:06.899117 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 77/160] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:32:06 2022] DELETE /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:32:06.905865 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:06.906792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] [instance: b6fc8045-3334-4a65-8f0c-abb0fccd473e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:06.913173 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:06.913666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:06.914100 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:06.914800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:06.915255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:06.915684 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:06.931258 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] HTTP exception thrown: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Request method failure captured: Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e HTTP/1.1 Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7Te58FYqnKHXdYhUjV8FopFcqhNTvoRO7GgyoW_Bdwp8v4y0eiotDnvQ5PqA8rovLVYZZCkTWgpSK8aBLt9PlXwDcx7FiZb0Ec3Yg-_LOv6MuR5eAlydokl4WHQjhSh75GPzXCwWMSTrYGrw1cD08PVPKHBoNCXBwsy1qtotTS9aEd0 Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 020b2f0e82d14211b286f1ac1e3823a9 Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:32:06.932824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_020b2f0e82d14211b286f1ac1e3823a9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/020b2f0e82d14211b286f1ac1e3823a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/020b2f0e82d14211b286f1ac1e3823a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/020b2f0e82d14211b286f1ac1e3823a9"}]}] Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 020b2f0e82d14211b286f1ac1e3823a9 Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1224924960 Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-DeleteServersTestJSON-1224924960-project Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: b0882cb9bf4744feae298fb8f10cebeb Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-DeleteServersTestJSON-1224924960-project Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.933943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': 'b6fc8045-3334-4a65-8f0c-abb0fccd473e'} Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:32:06.934703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. Aug 05 15:32:06.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:06.937527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] Returning 404 to user: Instance b6fc8045-3334-4a65-8f0c-abb0fccd473e could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:32:06.937527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-43e04b0c-6009-4fbb-99d3-08e50c36bc69 tempest-DeleteServersTestJSON-1224924960 tempest-DeleteServersTestJSON-1224924960-project] 10.222.0.40 "GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e" status: 404 len: 111 microversion: 2.1 time: 0.033630 Aug 05 15:32:06.937527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 84/161] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:06 2022] GET /compute/v2.1/servers/b6fc8045-3334-4a65-8f0c-abb0fccd473e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:32:07.657569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:07.658430 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:07.664194 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:07.664682 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:07.665118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:07.665843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:07.666270 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:07.666695 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:08.115331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:08.122951 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-fa28a3b2-a859-43e2-a5d0-2ecf9658b76f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.469232 Aug 05 15:32:08.123504 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 78/162] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:07 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:32:09.146842 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:09.148413 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:09.160657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:09.161606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:09.162063 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:09.162785 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:09.163830 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:09.164974 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:09.417004 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:09.425026 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b4109a94-d700-4dc7-8ae3-1865d428e706 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.284331 Aug 05 15:32:09.425594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 85/163] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:09 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:10.447608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:10.448171 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:10.456492 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:10.456977 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:10.457410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:10.458106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:10.458544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:10.458965 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:10.678218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:10.687075 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a2729fdf-92c0-4135-877a-49bacbba9397 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.244145 Aug 05 15:32:10.687850 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 79/164] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:10 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:11.708010 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:11.708699 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:11.718357 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:11.718858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:11.719300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:11.720003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:11.720482 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:11.731399 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:11.867447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:11.878183 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5f59b931-75f1-4e42-8e56-e742176dedc6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.173999 Aug 05 15:32:11.878737 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 86/165] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:11 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:12.907945 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:12.908768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:12.915862 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:12.916507 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:12.917014 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:12.920318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:12.920318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:12.920318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:13.053431 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:13.062819 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ad28b4fc-666c-4d30-9bb3-f4b68e262afa tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.159306 Aug 05 15:32:13.063931 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 80/166] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:12 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:14.084861 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:14.085424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:14.091980 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:14.093106 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:14.093452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:14.094161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:14.094666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:14.095089 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:14.242506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:14.250251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-bc4b7a08-e861-4af2-841b-7fe1692a4023 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.169371 Aug 05 15:32:14.250816 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 87/167] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:14 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:15.271135 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:15.271899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:15.278781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:15.280804 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:15.280804 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:15.280804 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:15.281105 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:15.281447 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:15.420798 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:15.428518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-456753fe-1664-486e-b769-516b2798aef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.161171 Aug 05 15:32:15.432173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 81/168] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:15 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:16.449776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:16.450446 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:16.468169 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:16.468169 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:16.468368 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:16.468954 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:16.469486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:16.469917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:16.700536 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:16.711651 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7a50ae15-0e85-4e63-865a-8c548036efa2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.265641 Aug 05 15:32:16.712451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 88/169] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:16 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:17.734739 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:17.735356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:17.741644 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:17.742131 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:17.742568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:17.743256 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:17.743708 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:17.744155 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:17.880350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:17.890145 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a2447383-02d9-4d2b-9901-394a48c9abc9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.159839 Aug 05 15:32:17.890923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 82/170] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:17 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:18.911664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:18.912827 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:18.921038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:18.921038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:18.921038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:18.921038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:18.921543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:18.921972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:19.064958 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:19.072426 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2f06b656-f0fb-47e5-b611-6ffc9f3a715d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.165511 Aug 05 15:32:19.072993 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 89/171] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:18 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:20.097362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:20.098049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:20.104536 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:20.105046 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:20.105477 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:20.106165 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:20.106612 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:20.107028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:20.268402 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:20.278556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9b4f829d-a6bb-4aae-841b-5c3ef1eb475e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1522 microversion: 2.1 time: 0.185335 Aug 05 15:32:20.279244 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 83/172] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:20 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:21.298794 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:21.299402 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:21.305789 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:21.306270 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:21.306705 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:21.307388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:21.307870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:21.308293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:21.438479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:21.446340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-33dee8c4-e355-4715-8284-e7613e16a1e6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1502 microversion: 2.1 time: 0.151370 Aug 05 15:32:21.446900 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 90/173] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:21 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:21.467136 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:21.468374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:21.474309 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:21.474899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:21.475295 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:21.476083 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:21.476480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:21.476898 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:21.611309 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:21.618844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-fa452b30-3478-4844-97fb-08841f7c85eb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1516 microversion: 2.1 time: 0.155729 Aug 05 15:32:21.619395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 84/174] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:21 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:23.631660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:23.633878 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:23.636221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:23.640842 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:23.641326 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:23.641762 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:23.642457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:23.642907 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:23.643332 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:23.664805 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lazy-loading 'flavor' on Instance uuid 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:32:23.961488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0d2741e9-b01d-4807-b373-ab8ee1af511f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47/action" status: 200 len: 32 microversion: 2.1 time: 0.333776 Aug 05 15:32:23.962214 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 91/175] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:32:23 2022] POST /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47/action => generated 32 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 15:32:23.972491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:23.973129 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:23.979211 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:23.979629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:23.980059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:23.980774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:23.981223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:23.981666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:24.122571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:24.124822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=100 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:24.130770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-553cbe14-1154-4e6a-8327-a2b6208c41a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.162387 Aug 05 15:32:24.131338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 85/176] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:23 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:25.152971 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:25.154397 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:25.160674 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:25.161173 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:25.161603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:25.162353 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:25.162810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:25.163234 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:25.334114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:25.341503 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-910dcad3-443b-4264-9ada-bcf0d07c53b9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.193497 Aug 05 15:32:25.342067 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 92/177] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:25 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:26.363982 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:26.365399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:26.372609 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:26.373325 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:26.374013 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:26.375473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:26.376275 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:26.376842 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:26.554147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:26.562318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c6584e13-4c87-4afb-b7e9-5094a33f333f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.201577 Aug 05 15:32:26.563011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 86/178] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:26 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:27.584627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:27.585242 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:27.591862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:27.592393 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:27.592874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:27.593566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:27.594021 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:27.594487 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:27.744700 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:27.753176 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1218007f-2e9d-434c-a2c5-7a7d92e63c72 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.172508 Aug 05 15:32:27.753932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 93/179] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:27 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:28.774733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:28.775345 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:28.781251 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:28.781731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:28.782167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:28.782839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:28.783287 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:28.783703 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:28.916765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:28.924980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b9fc21be-22cd-4c9c-ac9a-c0c35c92292a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.154058 Aug 05 15:32:28.947151 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 87/180] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:28 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:29.959466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:29.960381 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:29.967070 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:29.968226 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:29.968787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:29.969730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:29.970391 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:29.970918 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:30.125764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:30.133981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e365bf3c-9a1f-470f-95b1-3a9eadf3ba62 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.178968 Aug 05 15:32:30.139931 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 94/181] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:29 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:31.172410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:31.172918 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:31.183418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:31.183418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:31.183418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:31.183418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:31.183882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:31.183882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:31.314433 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:31.321882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-51de7b62-7715-4cfa-86f9-6bf78a4c4e7b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.157480 Aug 05 15:32:31.322444 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 88/182] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:31 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:32.343780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:32.344433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:32.351266 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:32.351801 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:32.352303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:32.353137 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:32.353588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:32.354007 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:32.500942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:32.510165 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-eb255c3e-c770-414b-ac3e-c1bd2e3b2513 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.171026 Aug 05 15:32:32.510967 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 95/183] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:32 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:33.532848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:33.533463 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:33.535372 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=32 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:33.539973 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:33.540482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:33.540914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:33.541600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:33.542053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:33.542499 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:33.708654 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:33.716040 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-12ddedbf-683e-4c66-ac64-877c07831e77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.187772 Aug 05 15:32:33.716649 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 89/184] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:33 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:34.739006 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:34.739961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:34.746858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:34.747246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:34.747676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:34.748468 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:34.748915 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:34.749613 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:34.753670 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:35.102031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:35.109594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6e20b568-714a-4471-a1dd-44c20e01082c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.375596 Aug 05 15:32:35.110145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 96/185] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:34 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:36.131701 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:36.132376 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:36.138213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:36.140823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:36.140823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:36.140823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:36.140823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:36.141160 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:36.273162 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:36.281344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0e20f08b-e6a3-4b68-8407-c5b6cb80a40f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.153529 Aug 05 15:32:36.281908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 90/186] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:36 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:37.301962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:37.302464 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:37.309420 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:37.309917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:37.310358 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:37.311060 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:37.311525 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:37.311951 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:37.442895 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:37.450544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2eaac09c-becf-4695-b12d-1b14242aa2cb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.152651 Aug 05 15:32:37.451096 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 97/187] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:37 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:38.475302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:38.479194 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:38.481960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:38.482441 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:38.482875 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:38.483599 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:38.484004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:38.484980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:38.632246 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:38.646742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-bac33150-5f23-4b8c-b69f-1363ebfb2551 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.178900 Aug 05 15:32:38.647829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 91/188] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:38 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:39.668862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:39.669728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:39.676939 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:39.680170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:39.680170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:39.680170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:39.680170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:39.680582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:39.824018 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:39.828918 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-884c76aa-4fb3-4ef1-9b0c-dfcf8ed8ff86 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.163882 Aug 05 15:32:39.830080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 98/189] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:39 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:40.852044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:40.852960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:40.859186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:40.859679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:40.860291 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:40.860850 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:40.861301 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:40.861924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:40.983025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:40.983691 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:40.992431 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:40.993253 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:40.993919 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:40.995323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:40.995946 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:40.996701 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:41.031688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7be9261a-bc21-410e-9d30-444dca73c513 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/ips" status: 200 len: 147 microversion: 2.1 time: 0.052150 Aug 05 15:32:41.032468 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 99/190] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:32:40 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/ips => generated 147 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:32:41.059576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:41.068024 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f37e2154-a824-4514-9a4c-66da79ee9ef5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.220093 Aug 05 15:32:41.068634 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 92/191] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:40 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:42.089688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:42.090289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:42.097849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:42.098372 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:42.109717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:42.109717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:42.109717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:42.109717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:42.253924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:42.261259 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0c909130-cd36-45b5-bd03-0b9467ebd271 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.175481 Aug 05 15:32:42.261852 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 100/192] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:42 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:43.285118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:43.285726 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:43.291969 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:43.292487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:43.295814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:43.295814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:43.295814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:43.295814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:43.439459 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:43.448155 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b4ca0aef-9e28-4a7c-bba6-8333c7991055 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.167581 Aug 05 15:32:43.452180 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 93/193] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:43 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:44.470086 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:44.470723 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:44.478976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:44.479542 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:44.479990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:44.480744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:44.481349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:44.481780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:44.653601 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:44.662063 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-12f31771-6c3e-4cc5-82e6-b5067a0cbcc7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.195983 Aug 05 15:32:44.662624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 101/194] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:44 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:45.685079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:45.685909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:45.693281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:45.694269 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:45.694421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:45.695194 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:45.695744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:45.696282 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:45.846689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:45.854121 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-054b7a9b-4862-4d19-99c7-ae3c156e1613 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1502 microversion: 2.1 time: 0.173159 Aug 05 15:32:45.854693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 94/195] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:45 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:45.876100 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c60da28c-e980-49c4-bb17-ca80c75da283"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:45.878979 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:45.885436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:45.885814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:45.886419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:45.887383 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:45.887976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:45.888732 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:45.915496 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] HTTP exception thrown: Cannot 'attach_volume' instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 while it is in vm_state rescued Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Request method failure captured: Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: POST /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47/os-volume_attachments HTTP/1.1 Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 74 Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TeyvX6nv2b1b8Cp3qCnIQE1DTuxuqUOIFE8kIGCHP9No9BBdDY6X3kSB7FmWI_1Az8YDMKeMFiKHBo9co4NJQuTnEuPXyjbBeZ9e34AeBB2i8xIOo8qY2aaI8qHymt6hMOr_5O5a2vDmRtWc1JnsfKMfaY_QfZAYF-4ujPrWLQNxcw Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:32:45.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1cb48dbd26c747d290bf3e666e65027a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1cb48dbd26c747d290bf3e666e65027a"}]}] Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: cb055110c77543c1861dfd8c155d7582 Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {"volumeAttachment": {"volumeId": "c60da28c-e980-49c4-bb17-ca80c75da283"}} Aug 05 15:32:45.918538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Cannot 'attach_volume' instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 while it is in vm_state rescued Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'server_id': '2eaf6904-d36e-48d4-9d13-cd73e2e9af47', 'body': {'volumeAttachment': {'volumeId': 'c60da28c-e980-49c4-bb17-ca80c75da283'}}} Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:32:45.919224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 while it is in vm_state rescued Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:32:45.925447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:32:45.926664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:32:45.926664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:32:45.926664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 while it is in vm_state rescued Aug 05 15:32:45.926664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:32:45.926664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Returning 409 to user: Cannot 'attach_volume' instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 while it is in vm_state rescued {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:32:45.926664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c5f60030-7f51-4dde-8a9a-fd08b05462fd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046856 Aug 05 15:32:45.926664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 102/196] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:32:45 2022] POST /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 15:32:45.936826 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:45.937366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:45.943995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:45.944515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:45.944944 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:45.945697 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:45.946089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:45.946513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:46.180218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0650078e-a8c1-4e34-9ece-24889ac753ce tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47/action" status: 202 len: 0 microversion: 2.1 time: 0.246150 Aug 05 15:32:46.181469 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 95/197] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:32:45 2022] POST /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:32:46.192210 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:46.194367 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:46.204106 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:46.205310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:46.205746 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:46.206638 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:46.207290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:46.207848 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:46.501683 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:46.510505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ae232685-1121-4c46-b1f6-2e5aba28b63e tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1510 microversion: 2.1 time: 0.324589 Aug 05 15:32:46.511084 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 103/198] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:46 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:47.429079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "602e87cf-e58d-4b16-a68a-06e5e72c9c27"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:47.431515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:47.440421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:47.440907 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:47.441341 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:47.442039 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:47.442485 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:47.442901 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:47.532957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:47.534211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:47.552055 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:47.552710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:47.557163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:47.557163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:47.557163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:47.557163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:47.741253 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:47.750195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4348a44a-5f64-4993-a4fb-71e512f30745 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1510 microversion: 2.1 time: 0.222147 Aug 05 15:32:47.750757 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 104/199] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:47 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:48.774675 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:48.775179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:48.782278 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:48.782779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:48.783221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:48.783958 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:48.784584 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:48.788761 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:48.993324 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:49.001420 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0b42b373-6964-4e92-86c3-ec1c0f02af0b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1510 microversion: 2.1 time: 0.233015 Aug 05 15:32:49.002065 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 105/200] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:48 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:32:49.007808 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:49.008329 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:49.014358 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:49.015573 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:49.016009 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:49.020781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:49.020781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:49.020781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:49.064534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9c1f35b8-7460-437d-92f6-38d9c8f205e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/ips" status: 200 len: 151 microversion: 2.20 time: 0.060948 Aug 05 15:32:49.065189 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 106/201] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Aug 5 15:32:49 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:32:49.361346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9eebf042-f22f-4289-8804-4c294fd8dd13 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.936321 Aug 05 15:32:49.362856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 96/202] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:32:47 2022] POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/os-volume_attachments => generated 194 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:32:50.025520 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:50.026390 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:50.038998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:50.039886 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:50.040606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:50.041448 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:50.042779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:50.043479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:50.364051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:50.372017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-bc2bb2a4-fde6-44f9-8b7f-8d2d8491aee2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1516 microversion: 2.1 time: 0.351691 Aug 05 15:32:50.372617 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 107/203] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:50 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1516 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:52.099541 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-212adbbc-2e1d-4c9f-98a6-9d4007ac461c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'create', calling method: .version_select at 0x7fcb1580eca0>, body: {"keypair": {"name": "tempest-keypair-2025074384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo0i/SLZUeBhJKM7d/L6qoCwq8RetH4f52DMZ44Jq8MArOkTEiHA9BO4zQKbFDbGTJ4m+PVkv7n4gNwLo1koaH2FpiC5ZXPS1J58svLtYCRuDEIl2ZhRj66Y6W4cSqsAA=="}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:52.159326 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-212adbbc-2e1d-4c9f-98a6-9d4007ac461c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Getting quotas for project 1cb48dbd26c747d290bf3e666e65027a. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:32:52.178893 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-212adbbc-2e1d-4c9f-98a6-9d4007ac461c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Getting quotas for user cb055110c77543c1861dfd8c155d7582 and project 1cb48dbd26c747d290bf3e666e65027a. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:32:52.335885 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-212adbbc-2e1d-4c9f-98a6-9d4007ac461c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.235338 Aug 05 15:32:52.335885 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 97/204] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:32:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:32:52.495531 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:52.496090 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:52.512027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:52.513023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:52.513611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:52.514652 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:52.515265 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:52.515905 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:52.603838 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lazy-loading 'flavor' on Instance uuid c377a731-4e6f-47c0-96f5-1b3e2237897d {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:32:53.126169 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7445fe0e-64ff-47d3-b8c7-8a33216ddcd3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/action" status: 202 len: 0 microversion: 2.20 time: 0.635362 Aug 05 15:32:53.126889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 108/205] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 5 15:32:52 2022] POST /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:32:53.136933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:53.137999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:53.175741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:53.177375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:53.178148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:53.179229 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:53.182474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:53.182917 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:53.469407 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:53.526167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:53.528015 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:53.538246 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0ddf92bc-af5f-496e-941e-e89b60b5bb55 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.397938 Aug 05 15:32:53.538898 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 98/206] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:32:53 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:32:54.568031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:54.568770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:54.570908 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=36 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:54.588262 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:54.588766 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:54.594436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:54.594436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:54.594436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:54.594436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:55.150750 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:55.163268 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:55.178864 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:55.178864 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f5208dd9-69c2-49c6-8d4a-04c302596824 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.612456 Aug 05 15:32:55.178864 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 109/207] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:32:54 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:32:55.949457 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-540550150", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51a7564f-6f88-44aa-8bd2-cac8188d6f98"}], "security_groups": [{"name": "tempest-securitygroup--1541937659"}], "key_name": "tempest-keypair-2025074384", "user_data": "}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:56.202793 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:56.203415 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:56.215810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:56.221028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:56.222849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:56.223564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:56.224436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:56.227438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:56.387757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] validate_networks() for [('51a7564f-6f88-44aa-8bd2-cac8188d6f98', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:32:56.665935 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:56.699898 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:56.701972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:56.703358 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-64aafec4-1e46-44f5-a256-002311711e24 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.505805 Aug 05 15:32:56.730456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 110/208] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:32:56 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:32:57.133666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:32:57.134123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:32:57.134760 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:32:57.135287 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:32:57.135795 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:32:57.158026 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:57.158715 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:57.159375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:57.160327 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:57.162659 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:57.163171 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:57.168410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:57.209136 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Getting quotas for project 1cb48dbd26c747d290bf3e666e65027a. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:32:57.222604 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Getting quotas for user cb055110c77543c1861dfd8c155d7582 and project 1cb48dbd26c747d290bf3e666e65027a. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:32:57.259080 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:32:57.261495 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:32:57.443488 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5e60dd1e-ce1c-4a56-9b4e-d417f6f68e4d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.499067 Aug 05 15:32:57.447258 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 99/209] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:32:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:32:57.482029 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1caba39b-243b-4f4d-8ee3-b2daa115345a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:57.483510 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1caba39b-243b-4f4d-8ee3-b2daa115345a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:57.630756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1caba39b-243b-4f4d-8ee3-b2daa115345a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:57.662109 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1caba39b-243b-4f4d-8ee3-b2daa115345a tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1245 microversion: 2.1 time: 0.207275 Aug 05 15:32:57.680091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 111/210] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:57 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1245 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:57.708356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3aebc355-d093-4774-bcdf-a9fca11f2ade tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:57.718904 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3aebc355-d093-4774-bcdf-a9fca11f2ade tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:57.719737 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3aebc355-d093-4774-bcdf-a9fca11f2ade tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:57.720458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3aebc355-d093-4774-bcdf-a9fca11f2ade tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:57.729975 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:57.731151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:57.751004 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:57.751793 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:57.752583 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:57.753462 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:57.754098 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:57.754678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:57.855279 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3aebc355-d093-4774-bcdf-a9fca11f2ade tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Going to try to stop instance {{(pid=118722) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 15:32:58.002138 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:58.004867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:32:58.012564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:58.015414 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:58.016914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4de8a573-e08e-47e6-81d0-db04ada1a301 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.290699 Aug 05 15:32:58.027288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 112/211] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:32:57 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:32:58.084317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3aebc355-d093-4774-bcdf-a9fca11f2ade tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/action" status: 202 len: 0 microversion: 2.1 time: 0.372115 Aug 05 15:32:58.084317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 100/212] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:32:57 2022] POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:32:58.099632 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:58.100367 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:58.118063 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:58.118738 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:58.119284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:58.120712 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:58.121383 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:58.122411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:58.366244 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:58.380451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-95215a22-afdf-4309-9061-2144e969f566 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.299546 Aug 05 15:32:58.381616 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 101/213] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:58 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:32:58.490106 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-27b3ccae-da9c-42bc-9af3-eddb59afed28 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Action: 'create', calling method: .version_select at 0x7fcb14efcaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1091585729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL6Vr9DZDgDq8NL4VJ7HK5bWg3i6f+XWcinFMLxkSHnUJWX6sXdRYbHOQsMm+lSj/1SEUNgKT9nDZAKFkQ3jTxwLXBHZMM0JBnxhd8z3X3dik4Vtjq9mKC3gRza2QIZew=="}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:32:58.506216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-27b3ccae-da9c-42bc-9af3-eddb59afed28 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Getting quotas for project 99b26247f85d45c0a7c1e763758f2e69. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:32:58.510181 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-27b3ccae-da9c-42bc-9af3-eddb59afed28 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Getting quotas for user 1782b4e84c9f484297e17c248738105c and project 99b26247f85d45c0a7c1e763758f2e69. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:32:58.625426 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-27b3ccae-da9c-42bc-9af3-eddb59afed28 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.592041 Aug 05 15:32:58.626034 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 113/214] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:32:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:32:58.686493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a2f3fa02-52bd-4b12-9852-71b2b3c0f7a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:58.687547 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a2f3fa02-52bd-4b12-9852-71b2b3c0f7a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:58.748690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a2f3fa02-52bd-4b12-9852-71b2b3c0f7a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:58.764429 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a2f3fa02-52bd-4b12-9852-71b2b3c0f7a7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1245 microversion: 2.1 time: 0.077252 Aug 05 15:32:58.764429 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 102/215] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:58 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:59.043565 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:59.044252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:59.051772 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:59.052504 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:59.053093 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:59.055512 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:59.060161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:59.060161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:59.292625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:59.302357 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:59.304046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:59.306356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a228ad43-61cd-497b-b798-85792cd88e1b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.266341 Aug 05 15:32:59.306356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 114/216] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:32:59 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:32:59.414222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:59.418404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:59.446955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:59.449821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:59.452445 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:59.457034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:59.458713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:59.461581 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:59.876980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:59.876980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-28c96cc5-6965-4c3f-af8e-e425e7ba5e6d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.331028 Aug 05 15:32:59.876980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 103/217] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:59 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:32:59.877388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:32:59.877388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:32:59.877388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:59.877388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:59.878162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:59.878162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:32:59.878162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:32:59.878162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:32:59.878566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:32:59.878566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b02dd922-8beb-44b9-9fe3-33a02de092d4 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1297 microversion: 2.1 time: 0.090297 Aug 05 15:32:59.878566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 115/218] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:32:59 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:00.330943 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:00.331761 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:00.349360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:00.349882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:00.350552 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:00.351514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:00.352023 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:00.352690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:00.658287 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:00.668694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:00.672821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:00.672821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-fb5ef0eb-2c9d-4cf4-aee2-7a4f6489ce9f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.345968 Aug 05 15:33:00.686888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 104/219] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:00 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:00.895568 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:00.896196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:00.901253 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:00.902496 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:00.910452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:00.917240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:00.921169 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:00.921979 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:00.922664 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:00.923862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:00.924625 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:00.925582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:00.926233 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:00.926920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:00.928186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:00.930163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:01.215642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:01.225271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d7466b38-e59f-4457-9a0d-4d4cdf425dab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1315 microversion: 2.1 time: 0.327717 Aug 05 15:33:01.225794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 105/220] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:00 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:33:01.289993 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:01.300753 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a8074f54-968a-4075-8bbe-8c48f6361403 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.408882 Aug 05 15:33:01.301378 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 116/221] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:00 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:01.697830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:01.698981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:01.706157 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:01.708705 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:01.709384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:01.710315 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:01.710979 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:01.711605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:01.954495 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:01.966493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:01.972640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:01.973902 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8ee74c61-4229-48ef-b5e7-2a8c0509204e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.280391 Aug 05 15:33:01.974908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 106/222] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:01 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:02.247767 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:02.248362 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:02.254887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:02.255441 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:02.255875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:02.256647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:02.257097 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:02.258152 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:02.327375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:02.328010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:02.332288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:02.338025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:02.338527 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:02.338966 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:02.339731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:02.342509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:02.343047 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-337e6b6f-ffc3-43d4-8b89-6721fa915ba1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1303 microversion: 2.1 time: 0.098498 Aug 05 15:33:02.343460 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:02.344022 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 117/223] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:02 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:02.600187 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:02.619928 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b163a627-ce5d-4738-8b43-28cc80e3c4f3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.300374 Aug 05 15:33:02.624474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 107/224] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:02 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:03.005526 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:03.006145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:03.031174 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:03.031739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:03.033213 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:03.034308 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:03.035659 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:03.036306 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:03.265535 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:03.269394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:03.271322 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:03.273185 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-021eb9e9-b31d-41d7-9623-ab76b99b566a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.278095 Aug 05 15:33:03.294026 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 118/225] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:02 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:03.365661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:03.366838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:03.389441 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:03.391581 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:03.392583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:03.393310 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:03.393763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:03.396189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:03.570351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:03.580332 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-6709be92-75b2-4817-8bc4-6fb59877b593 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.217829 Aug 05 15:33:03.580916 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 108/226] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:03 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:03.647132 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:03.647731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:03.653688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:03.657648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:03.657648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:03.657648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:03.657648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:03.657989 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:03.936871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:03.946545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-cae1129a-cffd-48fe-ad11-7419656e84cf tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.303566 Aug 05 15:33:03.947333 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 119/227] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:03 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:04.003428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-091af996-5b28-4cd4-9b49-db4161de0259 req-8f43cbd9-33c2-4516-8b8c-67f41c822e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110f9b00-a9dd-4382-8bee-6dafd1756b9e", "tag": "90dc2636-6d0d-4dc4-ab72-df8554ef6ebc"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:04.008391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:04.014102 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-091af996-5b28-4cd4-9b49-db4161de0259 req-8f43cbd9-33c2-4516-8b8c-67f41c822e95 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:04.014570 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-091af996-5b28-4cd4-9b49-db4161de0259 req-8f43cbd9-33c2-4516-8b8c-67f41c822e95 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:04.014997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-091af996-5b28-4cd4-9b49-db4161de0259 req-8f43cbd9-33c2-4516-8b8c-67f41c822e95 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:04.026183 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-091af996-5b28-4cd4-9b49-db4161de0259 req-8f43cbd9-33c2-4516-8b8c-67f41c822e95 service nova] Creating event network-changed:90dc2636-6d0d-4dc4-ab72-df8554ef6ebc for instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e on hv-cinder-84989 Aug 05 15:33:04.042167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-091af996-5b28-4cd4-9b49-db4161de0259 req-8f43cbd9-33c2-4516-8b8c-67f41c822e95 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042397 Aug 05 15:33:04.042834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 109/228] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:33:04.297323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:04.298669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:04.312338 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:04.313415 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:04.314871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:04.315825 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:04.316661 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:04.317162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:04.501937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:04.511366 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:04.512923 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:04.514773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-70705c64-a314-4aea-8f0d-6dbca16cf009 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.222026 Aug 05 15:33:04.515330 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 120/229] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:04 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:04.604384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:04.605258 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:04.614270 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:04.615056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:04.616016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:04.621004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:04.621487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:04.621928 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:04.769967 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:04.777843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e56610f8-8f76-4751-9b9d-2525552bbe87 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.178635 Aug 05 15:33:04.788454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 110/230] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:04 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:04.968839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:04.969530 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:04.975878 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:04.976383 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:04.976813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:04.977618 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:04.977945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:04.978646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:05.112745 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:05.121137 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-45a71f97-57c1-4736-a1cc-7a6188c0a6c8 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.156242 Aug 05 15:33:05.121699 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 121/231] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:04 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:05.540548 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:05.541157 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:05.547810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:05.548316 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:05.548745 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:05.549437 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:05.549883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:05.550300 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:05.706027 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:05.714071 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:05.715582 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:05.717414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b2e12858-8af6-4f4e-a671-74ea1f78fd97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.183125 Aug 05 15:33:05.717976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 111/232] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:05 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:05.799040 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:05.799637 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:05.806324 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:05.809776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:05.809776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:05.809776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:05.809776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:05.810710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:05.947429 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:05.955172 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2931a8ae-f4d9-4ae7-b9d0-314045bacfe0 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.160029 Aug 05 15:33:05.955738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 122/233] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:05 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:06.142079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:06.142688 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:06.148569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:06.149049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:06.149489 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:06.150175 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:06.150626 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:06.151052 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:06.289562 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:06.297830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-357b12a8-0ee4-45b8-bc3a-12b0f7395e36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.160137 Aug 05 15:33:06.298379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 112/234] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:06 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:06.740788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:06.741668 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:06.748059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:06.748580 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:06.749060 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:06.753184 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:06.753184 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:06.753184 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:06.891923 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:06.900432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:06.902013 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:06.903186 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-720af9b0-88b9-4399-bfaf-40cabbc1a891 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.166819 Aug 05 15:33:06.903756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 123/235] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:06 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:06.978524 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:06.979140 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:06.986312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:06.986821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:06.987284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:06.987972 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:06.988447 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:06.989141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:07.127038 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:07.136184 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b4363880-5aa5-4d3f-8ba6-24390745c3ab tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.162375 Aug 05 15:33:07.136762 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 113/236] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:06 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:07.319971 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:07.320627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:07.327640 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:07.328055 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:07.328567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:07.329342 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:07.329795 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:07.336321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:07.497183 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:07.505612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f8252720-e3fc-41a1-a462-63e97bbba273 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.189491 Aug 05 15:33:07.506177 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 124/237] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:07 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:07.927205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:07.927828 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:07.929922 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:07.936386 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:07.936945 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:07.937385 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:07.938103 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:07.938559 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:07.938987 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:08.077870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:08.085880 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:08.087366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:08.088641 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2728f77a-6829-4975-93e4-0110172a7bb3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.165517 Aug 05 15:33:08.089133 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 114/238] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:07 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:08.157311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:08.157922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:08.164331 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:08.164814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:08.165255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:08.165951 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:08.166404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:08.166827 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:08.298053 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:08.305492 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3f56d228-7f5b-4295-aa84-d48738b8a669 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.152556 Aug 05 15:33:08.306051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 125/239] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:08 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:08.526576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:08.527180 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:08.533214 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:08.533694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:08.534127 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:08.534809 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:08.535260 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:08.535685 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:08.664753 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:08.672632 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-956e65f3-185e-41ef-9a07-002afa745282 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.149851 Aug 05 15:33:08.673195 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 115/240] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:08 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:09.111220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:09.111853 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:09.113999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=6 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:09.118828 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:09.119329 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:09.119748 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:09.120465 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:09.120923 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:09.125301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:09.255347 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:09.269405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:09.270897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:09.272231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c5dec62f-f166-4894-931b-73b0dbb73db3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.164876 Aug 05 15:33:09.272783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 126/241] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:09 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:09.332744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:09.333348 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:09.335202 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=12 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:09.341288 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:09.341767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:09.342205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:09.342893 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:09.343341 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:09.343874 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:09.489726 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:09.497189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f4f4bf03-a0fd-4b4a-828e-5976fc812cb3 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.168343 Aug 05 15:33:09.497763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 116/242] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:09 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:09.693638 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:09.694159 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:09.700175 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:09.700657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:09.701094 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:09.701783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:09.702856 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:09.703282 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:09.831163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:09.839176 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ef3b3cc6-e0fa-42cc-9c20-a24efe85daa0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.149501 Aug 05 15:33:09.839747 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 127/243] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:09 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:10.299974 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:10.300847 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:10.308266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:10.309215 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:10.309797 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:10.310500 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:10.311117 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:10.311800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:10.314661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:10.459535 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:10.468550 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:10.470175 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:10.471771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-257cd558-c6f1-47b6-9647-ad2eccb498dd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.177341 Aug 05 15:33:10.472462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 117/244] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:10 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:10.525337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:10.525944 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:10.535751 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:10.536386 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:10.536825 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:10.537536 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:10.537987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:10.538413 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:10.673664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:10.681711 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7569cf2e-1fe6-483f-9cf7-3b27019c9136 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.160113 Aug 05 15:33:10.682286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 128/245] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:10 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:10.861228 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:10.862138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:10.868360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:10.868844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:10.869298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:10.869990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:10.870444 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:10.870898 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:11.023282 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:11.033662 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-bb83abac-bb89-4e72-aa96-a782120bef56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.176376 Aug 05 15:33:11.037225 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 118/246] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:10 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:11.268936 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-4bdbf1d8-a3dc-4489-8d74-862b90abccbd req-1dd57a71-edd8-43e9-a450-85990c07d322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110f9b00-a9dd-4382-8bee-6dafd1756b9e", "name": "network-vif-plugged", "status": "completed", "tag": "90dc2636-6d0d-4dc4-ab72-df8554ef6ebc"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:11.278246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-4bdbf1d8-a3dc-4489-8d74-862b90abccbd req-1dd57a71-edd8-43e9-a450-85990c07d322 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:11.278722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-4bdbf1d8-a3dc-4489-8d74-862b90abccbd req-1dd57a71-edd8-43e9-a450-85990c07d322 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:11.279149 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-4bdbf1d8-a3dc-4489-8d74-862b90abccbd req-1dd57a71-edd8-43e9-a450-85990c07d322 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:11.291290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-4bdbf1d8-a3dc-4489-8d74-862b90abccbd req-1dd57a71-edd8-43e9-a450-85990c07d322 service nova] Creating event network-vif-plugged:90dc2636-6d0d-4dc4-ab72-df8554ef6ebc for instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e on hv-cinder-84989 Aug 05 15:33:11.296696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-4bdbf1d8-a3dc-4489-8d74-862b90abccbd req-1dd57a71-edd8-43e9-a450-85990c07d322 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 Aug 05 15:33:11.297360 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 129/247] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:33:11.500277 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:11.500886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:11.507365 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:11.507842 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:11.508321 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:11.509052 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:11.509503 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:11.509924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:11.650807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:11.659419 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:11.661263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:11.662526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7d121256-17b4-484a-9325-4bb65f023162 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.166822 Aug 05 15:33:11.663081 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 119/248] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:11 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:11.707119 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:11.707822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:11.714516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:11.715010 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:11.715451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:11.716186 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:11.716646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:11.717121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:11.849229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:11.857043 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-13dd4c96-c3f6-496b-a3e3-94ba0d5459d7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.157944 Aug 05 15:33:11.857626 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 130/249] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:11 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:33:12.056911 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:12.057616 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:12.064378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:12.064867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:12.065306 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:12.066084 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:12.066539 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:12.067058 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:12.206223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:12.216230 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d3bfa798-0225-4596-a1eb-b639d1e65f36 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.163145 Aug 05 15:33:12.217568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 120/250] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:12 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:12.689785 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:12.690532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:12.696392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:12.696995 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:12.697379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:12.698079 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:12.698534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:12.698960 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:12.706039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:12.840945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:12.849586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:12.851076 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:12.852286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-074b2a4b-676d-4db1-9274-7cba48597ee9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.166598 Aug 05 15:33:12.852839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 131/251] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:12 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:12.877719 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:12.878345 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:12.885447 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:12.885903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:12.886338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:12.887047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:12.887497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:12.887926 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:13.024690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:13.032713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ab1dd6c6-5e12-4a78-bb87-599199d1f8ba tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1371 microversion: 2.1 time: 0.158868 Aug 05 15:33:13.033364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 121/252] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:12 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:13.238581 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:13.239627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:13.245973 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:13.246835 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:13.247377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:13.248203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:13.248859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:13.250008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:13.404953 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:13.413089 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a955226e-995d-4fdb-963b-a9ea9c765671 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.178376 Aug 05 15:33:13.413678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 132/253] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:13 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:13.879390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:13.879390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:13.885493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:13.885493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:13.885493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:13.885882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:13.886373 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:13.886842 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:14.022299 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:14.033889 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:14.035667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:14.036866 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3628f1fe-027d-4516-9200-36d68f1d0faa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.164527 Aug 05 15:33:14.037571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 122/254] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:13 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:14.056031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:14.056653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:14.063578 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:14.064185 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:14.064728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:14.065517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:14.066047 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:14.066582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:14.220283 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:14.229581 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c76f7bf3-8044-4279-a073-fedc161d579b tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1565 microversion: 2.1 time: 0.177277 Aug 05 15:33:14.230150 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 133/255] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:14 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:14.252843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:14.253641 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:14.263137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:14.263620 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:14.264186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:14.264749 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:14.265947 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:14.266530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:14.369997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f6b3dfd8-1e3c-4ba7-8c7b-e5e6b09265e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118769 Aug 05 15:33:14.369997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 123/256] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 15:33:14 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:33:14.435513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:14.436155 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:14.445290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:14.446008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:14.446586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:14.447460 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:14.448259 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:14.448683 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:14.644985 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:14.654182 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-029f9c5a-ac0b-4fbd-a946-55b156fd6bc7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.222474 Aug 05 15:33:14.654928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 134/257] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:14 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:15.065837 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:15.065837 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:15.080960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:15.081458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:15.081893 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:15.082607 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:15.083061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:15.083487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:15.251691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:15.261456 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:15.263137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:15.266173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ef9eed38-12d9-488c-b77f-ac740401a291 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.207085 Aug 05 15:33:15.266975 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 124/258] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:15 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:15.677994 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:15.678987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:15.685366 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:15.686094 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:15.686532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:15.687293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:15.687905 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:15.688528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:15.784254 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-b1e47243-d2e2-4e3d-8283-5ea63dbdfefd req-f295a429-6e79-475f-81b6-220117a2fbdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110f9b00-a9dd-4382-8bee-6dafd1756b9e", "tag": "90dc2636-6d0d-4dc4-ab72-df8554ef6ebc"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:15.795873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b1e47243-d2e2-4e3d-8283-5ea63dbdfefd req-f295a429-6e79-475f-81b6-220117a2fbdc service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:15.797104 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b1e47243-d2e2-4e3d-8283-5ea63dbdfefd req-f295a429-6e79-475f-81b6-220117a2fbdc service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:15.797553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b1e47243-d2e2-4e3d-8283-5ea63dbdfefd req-f295a429-6e79-475f-81b6-220117a2fbdc service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:15.809057 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-b1e47243-d2e2-4e3d-8283-5ea63dbdfefd req-f295a429-6e79-475f-81b6-220117a2fbdc service nova] Creating event network-changed:90dc2636-6d0d-4dc4-ab72-df8554ef6ebc for instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e on hv-cinder-84989 Aug 05 15:33:15.814309 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-b1e47243-d2e2-4e3d-8283-5ea63dbdfefd req-f295a429-6e79-475f-81b6-220117a2fbdc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034204 Aug 05 15:33:15.818498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 125/259] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:33:15.846976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:15.860881 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d6acb81f-da92-4f06-9f45-fab64b06e129 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.186903 Aug 05 15:33:15.861978 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 135/260] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:15 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:16.291891 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:16.292542 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:16.315451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:16.317518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:16.318579 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:16.319390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:16.320141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:16.320726 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:16.511924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:16.522031 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:16.523883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:16.525454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-6434dad7-11f9-420e-9743-569c800ee743 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.238408 Aug 05 15:33:16.526215 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 126/261] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:16 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:16.886031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:16.886940 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:16.894013 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:16.894516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:16.894949 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:16.895719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:16.896192 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:16.896613 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:17.045340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:17.053433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2b350c26-0a50-40ea-b5b1-5035203e0af6 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.171800 Aug 05 15:33:17.053989 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 136/262] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:16 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:17.549461 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:17.550074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:17.556479 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:17.558097 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:17.558097 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:17.558097 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:17.558593 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:17.559056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:17.692276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:17.700094 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:17.701610 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:17.702748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-30e2be76-ec60-4602-b818-7d1790f1b128 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.157860 Aug 05 15:33:17.703322 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 127/263] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:17 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:18.075195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:18.075834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:18.082678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:18.083161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:18.083621 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:18.084345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:18.084796 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:18.085218 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:18.216457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:18.225112 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-96ac2781-c76a-4f9b-bf9d-0dcebcfdb7da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.153839 Aug 05 15:33:18.225674 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 137/264] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:18 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:18.725782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:18.726536 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:18.733211 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:18.733754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:18.734330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:18.735761 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:18.736245 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:18.736668 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:18.876946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:18.884993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:18.886508 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:18.887698 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d02b3c55-0e18-44a6-abd9-acdfae52b382 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.165795 Aug 05 15:33:18.888292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 128/265] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:18 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:19.246563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:19.247182 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:19.254842 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:19.255330 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:19.255770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:19.256550 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:19.257012 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:19.257443 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:19.430903 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:19.440896 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d3f1a54f-4b67-42b1-8c97-b59e3b5a1b51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1725 microversion: 2.1 time: 0.198243 Aug 05 15:33:19.442018 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 138/266] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:19 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:19.912863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:19.913540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:19.919907 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:19.920420 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:19.920855 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:19.921546 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:19.922544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:19.922972 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:20.053732 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:20.061937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:20.063604 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:20.064815 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-095c2f5f-5dab-4dca-ae7e-292e8bcdc55b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.155952 Aug 05 15:33:20.065359 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 129/267] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:19 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:20.471200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:20.471806 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:20.478104 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:20.478583 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:20.479012 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:20.479693 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:20.480169 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:20.480588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:20.612429 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:20.621111 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d740bf25-dd93-40a9-891f-055fd1db50bc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1702 microversion: 2.1 time: 0.154310 Aug 05 15:33:20.621679 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 139/268] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:20 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1702 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:20.641695 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4242f810-9049-4e65-a284-37795efc29cb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:20.648439 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4242f810-9049-4e65-a284-37795efc29cb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:20.648923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4242f810-9049-4e65-a284-37795efc29cb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:20.649443 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4242f810-9049-4e65-a284-37795efc29cb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:20.674120 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4242f810-9049-4e65-a284-37795efc29cb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Going to try to start instance {{(pid=118722) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 15:33:20.833486 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4242f810-9049-4e65-a284-37795efc29cb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/action" status: 202 len: 0 microversion: 2.1 time: 0.195817 Aug 05 15:33:20.834095 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 130/269] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:33:20 2022] POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:33:20.842461 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:20.843074 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:20.849162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:20.849644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:20.850079 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:20.850817 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:20.851273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:20.851694 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:20.983648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:20.992046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c610f5cf-c5c3-4dcf-afb8-1a1723d601aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1711 microversion: 2.1 time: 0.153610 Aug 05 15:33:20.992649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 140/270] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:20 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:21.089152 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:21.089835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:21.095806 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:21.096379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:21.096814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:21.097500 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:21.097957 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:21.098378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:21.230531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:21.238832 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:21.240362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:21.241753 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a95e0f1c-9b8d-4eaf-b9c2-1f168a4fe647 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.157366 Aug 05 15:33:21.242301 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 131/271] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:21 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:22.015877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:22.016507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:22.023027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:22.023549 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:22.023982 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:22.024696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:22.025153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:22.025581 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:22.148296 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:22.156244 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ff094d35-44ac-4782-ad5f-36543d69fab9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1711 microversion: 2.1 time: 0.144244 Aug 05 15:33:22.156748 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 141/272] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:22 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1711 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:22.265191 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:22.265795 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:22.272355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:22.272837 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:22.273270 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:22.273960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:22.274411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:22.274831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:22.413177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:22.422513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:22.424908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:22.426091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-437c42b9-b3f9-499c-92a4-c981f04dc3c7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.164834 Aug 05 15:33:22.426728 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 132/273] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:22 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:23.169687 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-cb5ed93e-7b92-4763-8fda-d64f73f36066 req-9c510420-1155-4542-a809-9efb22e40921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c377a731-4e6f-47c0-96f5-1b3e2237897d", "name": "network-vif-plugged", "status": "completed", "tag": "a7e56405-70bc-42da-933f-8a3780bd6a0f"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:23.182354 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:23.183054 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:23.183158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cb5ed93e-7b92-4763-8fda-d64f73f36066 req-9c510420-1155-4542-a809-9efb22e40921 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:23.183558 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cb5ed93e-7b92-4763-8fda-d64f73f36066 req-9c510420-1155-4542-a809-9efb22e40921 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:23.184014 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cb5ed93e-7b92-4763-8fda-d64f73f36066 req-9c510420-1155-4542-a809-9efb22e40921 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:23.189169 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:23.189736 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:23.190235 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:23.190983 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:23.191506 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:23.191990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:23.195674 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-cb5ed93e-7b92-4763-8fda-d64f73f36066 req-9c510420-1155-4542-a809-9efb22e40921 service nova] Creating event network-vif-plugged:a7e56405-70bc-42da-933f-8a3780bd6a0f for instance c377a731-4e6f-47c0-96f5-1b3e2237897d on hv-cinder-84989 Aug 05 15:33:23.200647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-cb5ed93e-7b92-4763-8fda-d64f73f36066 req-9c510420-1155-4542-a809-9efb22e40921 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034569 Aug 05 15:33:23.201235 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 142/274] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:33:23.326159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:23.328561 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:23.335072 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e3c66392-af90-4cab-a8f8-16307cd6f323 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1711 microversion: 2.1 time: 0.160477 Aug 05 15:33:23.335649 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 133/275] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:23 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:23.451668 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:23.452456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:23.459081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:23.459563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:23.460001 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:23.460720 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:23.461172 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:23.461688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:23.592688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:23.601081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:23.602596 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:23.603752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d3f3d738-7bc1-474e-b81b-097e0b4192c1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.156519 Aug 05 15:33:23.604342 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 143/276] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:23 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:24.357460 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:24.358069 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:24.365749 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:24.366493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:24.366933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:24.367626 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:24.368105 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:24.368535 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:24.627130 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:24.627751 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:24.634569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:24.635062 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:24.635501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:24.636242 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:24.636702 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:24.637126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:24.919092 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:24.923029 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:24.927794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-64807c90-0aad-4e75-a4dc-8df6131b35d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1711 microversion: 2.1 time: 0.574346 Aug 05 15:33:24.931300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:24.932746 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:24.933938 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-77d55b78-5e06-46ce-8b31-519e66a512a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.310931 Aug 05 15:33:24.934770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 144/277] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:24 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:33:24.945971 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 134/278] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:24 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1711 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:25.952818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:25.953429 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:25.956431 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:25.957401 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:25.958009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:25.961245 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:25.961725 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:25.962155 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:25.962844 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:25.963297 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:25.963713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:25.964669 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:25.965239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:25.965680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:25.966398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:25.966849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:25.967274 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:26.165658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:26.173227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:26.179919 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-dc35573d-c787-4340-b2c6-77886c73abcb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1711 microversion: 2.1 time: 0.230771 Aug 05 15:33:26.180215 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:26.180534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 145/279] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:25 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1711 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:26.181950 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:26.183137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-73f4fe3b-71e5-44f0-8308-b9c43d0231d6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.230124 Aug 05 15:33:26.183662 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 135/280] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:25 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:33:27.201934 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:27.202553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:27.206170 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:27.206777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:27.208986 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:27.209476 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:27.209919 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:27.210623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:27.211082 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:27.211513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:27.213240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:27.213716 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:27.214149 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:27.214832 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:27.215283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:27.215705 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:27.401854 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:27.408853 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:27.412044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-73bb6464-9161-417f-ad2a-71ce7270cfd9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1711 microversion: 2.1 time: 0.214167 Aug 05 15:33:27.412813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 146/281] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:27 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1711 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:27.420382 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:27.420382 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:27.420382 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-92737fb1-792e-445b-96e5-ce52fefaf01a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.217360 Aug 05 15:33:27.423689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 136/282] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:27 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:33:28.435109 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:28.435640 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:28.442598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:28.443082 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:28.443517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:28.444241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:28.444696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:28.445124 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:28.445701 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:28.446303 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:28.452633 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:28.453107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:28.453538 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:28.454219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:28.455362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:28.455779 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:28.644225 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:28.648531 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:28.652820 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:28.654339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:28.655498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b6b20a68-8842-4b4a-8655-edbc4d773701 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.213696 Aug 05 15:33:28.656055 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 137/283] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:28 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:33:28.657163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-eed0b88e-19ac-49b4-829f-96e8b1ad2d51 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1715 microversion: 2.1 time: 0.225741 Aug 05 15:33:28.657657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 147/284] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:28 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1715 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:29.678995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:29.679528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:29.686037 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:29.686514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:29.686949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:29.687634 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:29.688106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:29.688528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:29.817798 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:29.825766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:29.827251 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:29.828419 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2e437c49-f7fd-4d39-b8b6-b397f165c1cc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.153417 Aug 05 15:33:29.828979 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 138/285] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:29 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:30.850831 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:30.851823 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:30.858565 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:30.859060 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:30.859772 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:30.860681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:30.861693 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:30.862129 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:30.877682 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:30.994999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:31.003587 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:31.005129 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:31.006320 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6c4d91da-df2d-453a-97be-fd4745786aad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1745 microversion: 2.20 time: 0.159538 Aug 05 15:33:31.006880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 148/286] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:30 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:31.448175 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-194805997", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1091585729", "security_groups": [{"name": "tempest-secgroup-smoke-1650709576"}], "block_device_mapping_v2": [{"uuid": "191e9262-6350-47a9-ae6e-7b94556473f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b73dcac-fd0b-490d-b366-7eddfd909984"}]}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:31.569164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] validate_networks() for [('9b73dcac-fd0b-490d-b366-7eddfd909984', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:33:32.008397 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:33:32.011718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:33:32.011718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:33:32.011718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:33:32.011718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:33:32.020185 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:32.020860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:32.021475 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:32.022364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:32.023077 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:32.023559 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:32.031657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:32.032279 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:32.042222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:32.043278 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:32.043911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:32.044862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:32.045206 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Getting quotas for project 99b26247f85d45c0a7c1e763758f2e69. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:33:32.045581 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:32.046078 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:32.054180 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Getting quotas for user 1782b4e84c9f484297e17c248738105c and project 99b26247f85d45c0a7c1e763758f2e69. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:33:32.137204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:33:32.139413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='191e9262-6350-47a9-ae6e-7b94556473f6',volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:33:32.240531 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:32.250822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:32.253121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:32.256436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-53a5adf9-96bc-44a1-ae4b-90e9087d4558 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.228829 Aug 05 15:33:32.256436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 149/287] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:32 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:32.885130 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ff9fee68-4b1a-41d0-b8db-465f7a0f726c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.439390 Aug 05 15:33:32.903626 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 139/288] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:33:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:33:32.914263 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5adca152-c404-48be-90d7-97ddaf66248a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:32.919127 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5adca152-c404-48be-90d7-97ddaf66248a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:32.984220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5adca152-c404-48be-90d7-97ddaf66248a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:32.984220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5adca152-c404-48be-90d7-97ddaf66248a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1094 microversion: 2.1 time: 0.070855 Aug 05 15:33:32.984220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 150/289] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:32 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:33.279184 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:33.280147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:33.287386 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:33.287880 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:33.288357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:33.289264 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:33.289719 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:33.290178 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:33.439445 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:33.449068 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:33.451088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:33.452534 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7aae02e1-2d50-4f19-9b7d-d44d8f618eda tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.177618 Aug 05 15:33:33.453082 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 140/290] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:33 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:34.017178 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:34.017178 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:34.033142 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:34.034337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:34.035004 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:34.035888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:34.036523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:34.037117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:34.112562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:34.122305 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-32dd44e3-7dc8-4ef2-ae87-93929af7ef9d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1144 microversion: 2.1 time: 0.118210 Aug 05 15:33:34.123040 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 151/291] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:34 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1144 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:34.481516 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:34.482247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:34.490728 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:34.491220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:34.491661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:34.492427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:34.493149 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:34.493575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:34.645455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:34.654283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:34.655985 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:34.657283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-820c1e1a-b32b-4f20-9e42-c509ee990c98 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.179924 Aug 05 15:33:34.657969 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 141/292] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:34 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:35.148318 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:35.155740 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:35.170931 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:35.172532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:35.173150 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:35.178537 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:35.179226 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:35.179820 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:35.254829 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:35.263733 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e8048467-6eed-44dc-8b2d-25851f77e966 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1144 microversion: 2.1 time: 0.121942 Aug 05 15:33:35.276575 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 152/293] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:35 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:35.685326 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:35.686700 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:35.689267 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:35.696866 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:35.698883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:35.698883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:35.699317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:35.699917 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:35.700631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:35.867482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:35.876209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:35.878012 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:35.879421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c7f5b099-df62-4543-8cd9-755e9ea36948 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.198550 Aug 05 15:33:35.879961 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 142/294] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:35 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:36.291942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:36.293358 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:36.314240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:36.314240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:36.314240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:36.314240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:36.314564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:36.314564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:36.416042 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:36.425423 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-dd43d236-3615-4023-851f-51b50a8b3ca8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1200 microversion: 2.1 time: 0.144183 Aug 05 15:33:36.440317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 153/295] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:36 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1200 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:36.907696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:36.909764 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:36.916537 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:36.917336 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:36.918029 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:36.918949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:36.919613 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:36.920303 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:37.083217 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:37.099686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:37.101593 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:37.103265 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-55ff81c1-a4e6-498d-8824-79b3da6139b7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.199815 Aug 05 15:33:37.104885 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 143/296] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:36 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:37.449932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:37.450844 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:37.457914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:37.458521 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:37.458955 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:37.459840 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:37.460492 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:37.461074 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:37.623392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:37.631496 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-da075bbf-8293-42bf-a634-b02f23912c76 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1278 microversion: 2.1 time: 0.185808 Aug 05 15:33:37.632000 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 154/297] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:37 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:38.126908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:38.127455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:38.133929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:38.134408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:38.134843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:38.135521 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:38.135977 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:38.136422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:38.269499 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:38.277339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:38.278850 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:38.280000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-592a061b-26b5-4ef0-931b-f7a3820de86d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.157107 Aug 05 15:33:38.280580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 144/298] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:38 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:38.653795 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:38.655313 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:38.662856 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:38.663426 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:38.664112 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:38.665038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:38.665681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:38.666296 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:38.825958 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:38.834885 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f4af3cbf-cf5f-45ae-88d5-24d777e77634 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1278 microversion: 2.1 time: 0.185949 Aug 05 15:33:38.836856 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 155/299] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:38 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:39.263368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-f9cb4e05-8c6f-4a16-aa24-acb1c69837ee req-d137689c-40ab-428b-a4de-a07783cd4ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17362876-caa1-4703-8c1f-11c09b21eea8", "tag": "a1c3ece6-03c8-4606-9433-311e8a05105f"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:39.274011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f9cb4e05-8c6f-4a16-aa24-acb1c69837ee req-d137689c-40ab-428b-a4de-a07783cd4ae4 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:39.274488 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f9cb4e05-8c6f-4a16-aa24-acb1c69837ee req-d137689c-40ab-428b-a4de-a07783cd4ae4 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:39.274943 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f9cb4e05-8c6f-4a16-aa24-acb1c69837ee req-d137689c-40ab-428b-a4de-a07783cd4ae4 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:39.292186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-f9cb4e05-8c6f-4a16-aa24-acb1c69837ee req-d137689c-40ab-428b-a4de-a07783cd4ae4 service nova] Creating event network-changed:a1c3ece6-03c8-4606-9433-311e8a05105f for instance 17362876-caa1-4703-8c1f-11c09b21eea8 on hv-cinder-84989 Aug 05 15:33:39.297112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-f9cb4e05-8c6f-4a16-aa24-acb1c69837ee req-d137689c-40ab-428b-a4de-a07783cd4ae4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041011 Aug 05 15:33:39.298020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 145/300] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:33:39.304017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:39.304829 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:39.311644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:39.312502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:39.313229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:39.314563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:39.315606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:39.316344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:39.483623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:39.501023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:39.503241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:39.504833 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2f869740-b396-45a5-9a3a-1fc2b46b4a28 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.205724 Aug 05 15:33:39.517572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 156/301] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:39 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:39.860854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:39.861866 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:39.874914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:39.883100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:39.883100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:39.883100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:39.883100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:39.883466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:40.043087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:40.054773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-83f67ec8-65f4-4d9c-aac9-5d1ca83fb621 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1278 microversion: 2.1 time: 0.198482 Aug 05 15:33:40.055890 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 146/302] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:39 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:40.529379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:40.529990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:40.539589 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:40.540101 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:40.540719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:40.541580 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:40.542191 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:40.542760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:40.696040 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:40.708635 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:40.710323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:40.711669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-bc9b8d39-7e46-4948-bf00-9b40da165726 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.186162 Aug 05 15:33:40.712394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 157/303] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:40 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:41.075886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:41.076530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:41.084270 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:41.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:41.085206 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:41.085903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:41.086391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:41.086823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:41.299360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:41.308379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b25eb66b-fa50-4063-bebb-853546882cce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1278 microversion: 2.1 time: 0.235984 Aug 05 15:33:41.324784 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 147/304] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:41 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:41.734854 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:41.735494 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:41.742143 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:41.742814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:41.743409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:41.744563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:41.745015 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:41.745447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:41.879344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:41.887243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:41.888783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:41.889947 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-96f11333-312a-4916-b355-4fcebcc7ca93 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.159017 Aug 05 15:33:41.896194 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 158/305] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:41 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:42.331978 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:42.332613 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:42.338011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:42.339313 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=6 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:42.346217 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:42.348829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:42.348829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:42.348829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:42.348829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:42.349172 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:42.518330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:42.526178 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-09b63d3d-2e55-4d8a-97ec-8215d6d2e7a5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1278 microversion: 2.1 time: 0.198970 Aug 05 15:33:42.526772 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 148/306] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:42 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:42.914613 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:42.915156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:42.921460 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:42.921945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:42.922387 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:42.923086 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:42.923544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:42.923970 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:42.978803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:43.059653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:43.068105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:43.069672 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:43.070883 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8570b487-b53b-4925-ae37-15e6f36e2d2b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1740 microversion: 2.20 time: 0.161163 Aug 05 15:33:43.071566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 159/307] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:42 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:43.550360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:43.550975 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:43.557955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:43.558431 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:43.558862 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:43.559540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:43.559989 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:43.560440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:43.693580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:43.700991 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b58147cb-24e2-498d-b1d7-f4bf55dc9b05 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1278 microversion: 2.1 time: 0.154539 Aug 05 15:33:43.701549 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 149/308] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:43 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:44.095420 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:44.096026 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:44.102888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:44.103272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:44.104586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:44.105337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:44.105949 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:44.106384 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:44.255141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:44.263722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:44.265356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:44.266540 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ced96d8e-9d9a-4dc3-b02a-4615603f84f5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1722 microversion: 2.20 time: 0.175003 Aug 05 15:33:44.267090 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 160/309] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:44 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:44.721754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:44.722346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:44.729247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:44.729749 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:44.730179 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:44.730886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:44.731342 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:44.731775 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:44.876945 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:44.884613 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-bd3f35b2-2ebd-4881-b4f8-c86dee280fec tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.166758 Aug 05 15:33:44.885176 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 150/310] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:44 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:45.291349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:45.292091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:45.298572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:45.299050 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:45.299479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:45.300189 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:45.300636 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:45.301056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:45.429721 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:45.437532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:45.439035 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:45.440214 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2bc9f5d2-a1ef-4f93-8a9f-a3ec3482b6a0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1722 microversion: 2.20 time: 0.153374 Aug 05 15:33:45.440764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 161/311] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:45 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:45.905453 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:45.906296 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:45.913059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:45.913543 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:45.913975 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:45.914685 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:45.915161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:45.915578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:46.050449 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:46.054317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=100 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:46.058588 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4d598ca4-a069-4d99-b630-8448fb0fcb49 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.157081 Aug 05 15:33:46.059141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 151/312] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:45 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:46.463126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:46.463730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:46.470115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:46.470596 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:46.471034 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:46.471723 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:46.472201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:46.472630 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:46.604211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:46.612212 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:46.613718 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:46.614868 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-983bde2f-7df2-4708-bfde-7c46a80a6596 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1722 microversion: 2.20 time: 0.155725 Aug 05 15:33:46.615435 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 162/313] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:46 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:33:47.081144 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:47.081751 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:47.089157 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:47.089574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:47.090009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:47.090697 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:47.091161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:47.091568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:47.229029 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:47.243759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-355ee187-67b7-4abe-a2c8-155f32aa39de tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.168222 Aug 05 15:33:47.244638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 152/314] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:47 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:47.355085 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-8003b259-5f83-48be-8d3c-893dc03c7dd7 req-0a49fa84-3ada-4c0f-a43a-6a9f67ed84af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c377a731-4e6f-47c0-96f5-1b3e2237897d", "name": "network-vif-unplugged", "status": "completed", "tag": "a7e56405-70bc-42da-933f-8a3780bd6a0f"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:47.364830 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-8003b259-5f83-48be-8d3c-893dc03c7dd7 req-0a49fa84-3ada-4c0f-a43a-6a9f67ed84af service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:47.365331 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-8003b259-5f83-48be-8d3c-893dc03c7dd7 req-0a49fa84-3ada-4c0f-a43a-6a9f67ed84af service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:47.365755 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-8003b259-5f83-48be-8d3c-893dc03c7dd7 req-0a49fa84-3ada-4c0f-a43a-6a9f67ed84af service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:47.376725 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-8003b259-5f83-48be-8d3c-893dc03c7dd7 req-0a49fa84-3ada-4c0f-a43a-6a9f67ed84af service nova] Creating event network-vif-unplugged:a7e56405-70bc-42da-933f-8a3780bd6a0f for instance c377a731-4e6f-47c0-96f5-1b3e2237897d on hv-cinder-84989 Aug 05 15:33:47.381961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-8003b259-5f83-48be-8d3c-893dc03c7dd7 req-0a49fa84-3ada-4c0f-a43a-6a9f67ed84af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030790 Aug 05 15:33:47.382554 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 163/315] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:33:47.641268 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:47.641887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:47.650528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:47.651034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:47.651502 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:47.652277 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:47.652741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:47.653168 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:47.789691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:47.797746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:47.799317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:47.800487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b702ce3f-9698-401b-8c87-3cf7e08b1e71 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1665 microversion: 2.20 time: 0.163258 Aug 05 15:33:47.801028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 153/316] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:47 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:47.824766 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3cbda83-bb9e-4f85-b425-983bd6ba0f4a"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:47.827231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:47.833438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:47.834540 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:47.840099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:47.840099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:47.840099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:47.840099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:48.265718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:48.266376 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:48.272629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:48.273115 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:48.273547 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:48.274229 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:48.274679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:48.275139 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:48.417157 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:48.418883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:48.426750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-540fb7d3-f511-45db-a3fa-dcc7acb1fdf8 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.165531 Aug 05 15:33:48.432051 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 154/317] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:48 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:48.810741 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-04bb87f6-7035-4da2-ae9e-6e18a02a8b74 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.990963 Aug 05 15:33:48.811399 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 164/318] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Aug 5 15:33:47 2022] POST /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments => generated 188 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:33:48.933677 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:48.934272 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:48.940780 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:48.941265 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:48.941701 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:48.942396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:48.942848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:48.943270 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:48.987778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118722) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 15:33:49.207758 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a90c2f6b-c84a-42a1-b387-990d4ec02d62 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/action" status: 202 len: 0 microversion: 2.20 time: 0.278017 Aug 05 15:33:49.208475 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 155/319] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 5 15:33:48 2022] POST /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 05 15:33:49.217482 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:49.218486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:49.225337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:49.225825 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:49.226260 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:49.226956 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:49.227413 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:49.227837 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:49.404011 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:49.410529 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:49.411970 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:49.413375 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7d8bbe3d-ba55-41b6-b5d8-e7abd6229af6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1751 microversion: 2.20 time: 0.199777 Aug 05 15:33:49.413969 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 165/320] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:49 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:33:49.449280 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:49.449914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:49.455903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:49.456425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:49.456849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:49.457532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:49.457986 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:49.459814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:49.625962 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:49.634532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d78e669c-5168-4836-a5ed-2a40b781bf0f tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.189215 Aug 05 15:33:49.635142 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 156/321] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:49 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:33:50.438928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:50.440053 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:50.446868 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:50.447354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:50.447855 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:50.448506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:50.448961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:50.449388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:50.593156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:50.602395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:50.603898 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:50.605081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6d1f3fe0-b13f-493e-abef-e613353a1816 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1751 microversion: 2.20 time: 0.172236 Aug 05 15:33:50.605662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 166/322] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:50 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:50.654915 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:50.655518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:50.662053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:50.663168 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:50.663596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:50.664299 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:50.664741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:50.665161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:50.812765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:50.822198 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-99d2046d-d39f-4a8c-ba34-4f5781d4e6f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.171195 Aug 05 15:33:50.825995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 157/323] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:50 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:51.627698 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:51.628334 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:51.634625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:51.635131 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:51.635579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:51.636289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:51.636740 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:51.637159 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:51.826741 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:51.837651 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:51.839853 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:51.845246 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:51.850760 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:51.854292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e654b36a-9094-4817-a6d0-b9ae8099f960 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1753 microversion: 2.20 time: 0.230421 Aug 05 15:33:51.856988 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 167/324] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:51 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:51.868012 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:51.868539 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:51.868980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:51.869705 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:51.870163 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:51.870586 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:52.026050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:52.034041 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-577214e3-9473-4256-bf7c-cc60181e9900 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.192805 Aug 05 15:33:52.038271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 158/325] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:51 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:52.888702 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:52.889382 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:52.895845 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:52.896356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:52.896793 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:52.897483 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:52.897935 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:52.898359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:53.042616 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:53.051379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:53.053253 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:53.054936 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4384a5e5-b1f7-4171-aeb0-29784649f07c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.170135 Aug 05 15:33:53.055692 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 168/326] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:52 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:53.057670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:53.058304 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:53.064923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:53.065425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:53.065852 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:53.066889 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:53.067348 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:53.067781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:53.199071 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:53.206956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-156bdf5e-ef9c-4008-830e-3f8ee5129834 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.154230 Aug 05 15:33:53.207513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 159/327] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:53 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:33:53.455881 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-4a7fb5b2-997c-4295-bbf7-d9b3407231ea req-cc2019fb-d30b-41c7-95fa-4669a43972a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17362876-caa1-4703-8c1f-11c09b21eea8", "name": "network-vif-plugged", "status": "completed", "tag": "a1c3ece6-03c8-4606-9433-311e8a05105f"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:33:53.466385 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-4a7fb5b2-997c-4295-bbf7-d9b3407231ea req-cc2019fb-d30b-41c7-95fa-4669a43972a8 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:53.466871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-4a7fb5b2-997c-4295-bbf7-d9b3407231ea req-cc2019fb-d30b-41c7-95fa-4669a43972a8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:53.467305 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-4a7fb5b2-997c-4295-bbf7-d9b3407231ea req-cc2019fb-d30b-41c7-95fa-4669a43972a8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:53.479340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-4a7fb5b2-997c-4295-bbf7-d9b3407231ea req-cc2019fb-d30b-41c7-95fa-4669a43972a8 service nova] Creating event network-vif-plugged:a1c3ece6-03c8-4606-9433-311e8a05105f for instance 17362876-caa1-4703-8c1f-11c09b21eea8 on hv-cinder-84989 Aug 05 15:33:53.484490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-4a7fb5b2-997c-4295-bbf7-d9b3407231ea req-cc2019fb-d30b-41c7-95fa-4669a43972a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032170 Aug 05 15:33:53.485148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 169/328] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:33:54.079495 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:54.080116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:54.087781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:54.088836 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:54.089259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:54.089944 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:54.090408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:54.090840 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:54.223200 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:54.228324 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:54.229195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:54.232015 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:54.233627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:54.234820 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-12f42a12-64c1-440b-89fa-2723dbc1eec9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.160625 Aug 05 15:33:54.235361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 160/329] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:54 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:54.236093 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:54.236549 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:54.236985 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:54.237854 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:54.238310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:54.239002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:54.377739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:54.385943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-aa157b2d-7cfe-42ef-8cce-59b07e082e13 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.162925 Aug 05 15:33:54.386497 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 170/330] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:54 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:33:55.258853 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:55.259463 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:55.266000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:55.266482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:55.266920 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:55.267613 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:55.268089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:55.268519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:55.406193 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:55.406868 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:55.416731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:55.420090 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:55.425666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:55.426366 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:55.426811 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:55.427544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:55.427999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:55.428444 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:55.434404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:55.435590 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-613c6af3-a885-4dd2-ad5e-02650a1f51c9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.181141 Aug 05 15:33:55.436157 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 161/331] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:55 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:55.573420 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:55.581553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2130d5b1-e258-4531-8e95-54987bc49b4d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.179421 Aug 05 15:33:55.582313 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 171/332] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:55 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:33:56.462582 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:56.463253 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:56.470494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:56.470969 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:56.471479 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:56.472200 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:56.472652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:56.473149 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:56.603325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:56.604046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:56.607849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=56 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:33:56.615073 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:56.616115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:56.616661 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:56.617100 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:56.618951 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:56.618951 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:56.618951 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:56.624662 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:56.626281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:56.627600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3e49eed0-f648-42d2-aa95-2e1822c4d35f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.172666 Aug 05 15:33:56.628281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 162/333] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:56 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:56.764784 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:56.772230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1d8c8044-6446-48a3-ad0e-78348232ac62 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.173827 Aug 05 15:33:56.773426 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 172/334] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:56 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:33:57.651312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:57.651914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:57.658523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:57.659001 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:57.659459 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:57.660188 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:57.660642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:57.661062 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:57.794480 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:57.795743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:57.803567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:57.805118 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:57.805637 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:57.806441 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:57.806981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:57.808249 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:57.808886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:57.817406 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:57.819091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:57.820528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ed13e869-adbc-409b-9ab1-34213c23c9cb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.173123 Aug 05 15:33:57.821358 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 163/335] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:57 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:57.952529 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:57.966904 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-674e10c5-ccce-46db-a16f-fea4fd8871e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.176289 Aug 05 15:33:57.980760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 173/336] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:57 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:33:58.845236 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:58.845956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:58.852741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:58.853229 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:58.853670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:58.854374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:58.854831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:58.855258 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:58.992446 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:33:58.993718 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:33:59.007814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:59.012145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:59.012145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:59.012145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:33:59.012145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:33:59.012504 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:33:59.016205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:59.025889 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:59.027398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:59.028601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-19d7742d-2469-44e4-b808-8cbc694a5746 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.187830 Aug 05 15:33:59.029707 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 164/337] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:33:58 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:33:59.158943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:33:59.167744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b8d64f9f-1f57-4edf-a403-ad6091081144 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.180753 Aug 05 15:33:59.168292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 174/338] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:33:58 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:00.054220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:00.054836 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:00.061398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:00.061884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:00.062319 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:00.063016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:00.063467 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:00.063890 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:00.189750 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:00.194147 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:00.207901 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:00.208298 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:00.208864 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:00.213786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:00.214547 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:00.215020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:00.215635 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:00.218299 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:00.221176 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:00.221176 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-cf3c5ce5-3fbb-4f49-b8ea-bd93d7e42d65 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.170916 Aug 05 15:34:00.221796 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 165/339] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:00 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:00.365310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:00.374559 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-bc2b1182-9549-4cc6-95d3-97af567a2658 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.189221 Aug 05 15:34:00.375443 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 175/340] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:00 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:01.244364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:01.245146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:01.252304 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:01.252873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:01.253380 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:01.254363 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:01.254879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:01.255372 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:01.388143 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:01.394817 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:01.395437 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:01.402317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:01.402804 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:01.403237 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:01.403700 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:01.403949 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:01.404428 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:01.404853 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:01.405443 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:01.406647 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-cefb4620-fffb-4c40-aba4-aed7e56b67f1 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.166636 Aug 05 15:34:01.407282 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 166/341] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:01 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:01.544001 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:01.551690 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-457fd72b-2eec-4749-bb2c-d9e215604d88 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.160591 Aug 05 15:34:01.552483 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 176/342] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:01 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:34:02.429387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:02.430042 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:02.436888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:02.437454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:02.437986 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:02.438786 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:02.439311 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:02.439811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:02.455779 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:02.576636 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:02.577898 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:02.587406 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:02.588166 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:02.589042 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:02.589933 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:02.590571 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:02.591203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:02.598924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:02.614294 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:02.616413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:02.617970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-08f51151-0ec1-4175-b3cd-ee414db36b9c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.192662 Aug 05 15:34:02.624151 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 167/343] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:02 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:02.765308 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:02.772808 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-44c0f2bb-0583-404d-a702-6e83b8633081 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.200073 Aug 05 15:34:02.774030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 177/344] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:02 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:02.793796 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "310b6d1e-5dc3-436b-85ae-532f92f38954"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:02.796329 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:02.802606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:02.803117 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:02.803568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:02.804359 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:02.804834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:02.805590 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:03.643482 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:03.644016 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:03.651669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:03.652187 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:03.652629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:03.653334 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:03.653788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:03.654244 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:03.783545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:03.792534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:03.794058 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:03.795223 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a4608b87-e76c-449f-a0b1-c69cb865644f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.156394 Aug 05 15:34:03.795780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 178/345] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:03 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:34:03.800150 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:03.800818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:03.806610 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:03.809474 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:03.809474 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:03.809474 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:03.809474 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:03.809968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:03.941151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:03.949320 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a41ea126-bc45-4296-bc51-c52cdea33e40 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1266 microversion: 2.1 time: 0.152585 Aug 05 15:34:03.949878 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 179/346] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:03 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:04.818398 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:04.819062 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:04.826262 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:04.826739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:04.827208 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:04.827897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:04.828410 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:04.828988 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:04.956603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:04.965257 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:04.966746 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:04.967882 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fe91762e-ea57-484b-a4ba-375b0b3c0b02 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.153545 Aug 05 15:34:04.968467 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 180/347] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:04 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:34:04.973117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:04.973717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:04.979683 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:04.983337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:04.983337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:04.983337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:04.983337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:04.983668 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:04.997136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:05.112506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:05.120541 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b0b9d019-a4f8-44af-8d89-d2cc752cf2fb tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1452 microversion: 2.1 time: 0.151159 Aug 05 15:34:05.121097 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 181/348] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:04 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:05.140459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:05.141059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:05.146553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:05.147033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:05.147463 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:05.148180 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:05.148641 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:05.149062 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:05.278002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:05.285403 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-efaef724-fff3-4436-bc59-380a40ee8de6 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1452 microversion: 2.1 time: 0.148401 Aug 05 15:34:05.286006 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 182/349] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:05 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:34:05.835352 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-dbf2fd09-34dd-4b2a-9d33-b0791b9553dd tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.045572 Aug 05 15:34:05.837554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 168/350] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:34:02 2022] POST /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments => generated 194 bytes in 3048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:34:05.992371 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:05.992990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:05.999590 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:06.000312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:06.000930 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:06.001638 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:06.002103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:06.002532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:06.203557 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:06.212023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:06.213552 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:06.214713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0642efb9-fd87-4223-91e0-928848f187ad tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.227888 Aug 05 15:34:06.215268 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 183/351] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:05 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:07.238428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:07.239047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:07.241033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:07.246014 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:07.246500 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:07.246946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:07.247642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:07.248119 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:07.248869 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:07.484736 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:07.493424 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:07.494864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:07.496021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8d1035f4-b3e0-45bc-b8e0-af2443ac726f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.262568 Aug 05 15:34:07.496904 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 169/352] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:07 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:07.761676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-71bf7853-e6dc-4ce4-8188-4d3e516b734a req-45fcc658-a16d-47d6-9bcd-d1b2313b81b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17362876-caa1-4703-8c1f-11c09b21eea8", "tag": "a1c3ece6-03c8-4606-9433-311e8a05105f"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:07.771319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-71bf7853-e6dc-4ce4-8188-4d3e516b734a req-45fcc658-a16d-47d6-9bcd-d1b2313b81b5 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:07.771797 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-71bf7853-e6dc-4ce4-8188-4d3e516b734a req-45fcc658-a16d-47d6-9bcd-d1b2313b81b5 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:07.772264 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-71bf7853-e6dc-4ce4-8188-4d3e516b734a req-45fcc658-a16d-47d6-9bcd-d1b2313b81b5 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:07.782909 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-71bf7853-e6dc-4ce4-8188-4d3e516b734a req-45fcc658-a16d-47d6-9bcd-d1b2313b81b5 service nova] Creating event network-changed:a1c3ece6-03c8-4606-9433-311e8a05105f for instance 17362876-caa1-4703-8c1f-11c09b21eea8 on hv-cinder-84989 Aug 05 15:34:07.787920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-71bf7853-e6dc-4ce4-8188-4d3e516b734a req-45fcc658-a16d-47d6-9bcd-d1b2313b81b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030622 Aug 05 15:34:07.788613 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 184/353] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:34:08.523116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:08.524318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:08.530798 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:08.531279 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:08.531713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:08.532506 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:08.532956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:08.533379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:08.676469 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:08.684920 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:08.686423 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:08.687572 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9f4aeee9-8032-422b-8832-0a1276cc0e1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.170505 Aug 05 15:34:08.688137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 170/354] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:08 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:09.712281 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:09.712896 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:09.719328 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:09.719813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:09.720275 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:09.720953 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:09.721400 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:09.721822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:09.857054 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:09.865357 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:09.866845 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:09.868041 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c3c5887a-7eb5-46bc-a6ee-2bf388b3a4dc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.160674 Aug 05 15:34:09.868619 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 185/355] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:09 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:10.890994 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:10.891601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:10.898098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:10.898574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:10.899008 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:10.899693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:10.900174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:10.900596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:11.041418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:11.049896 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:11.051521 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:11.052791 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4465909d-be17-4d79-b3f6-598995b03d47 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.165629 Aug 05 15:34:11.054249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 171/356] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:10 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:11.352041 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:11.353155 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:11.359706 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:11.360269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:11.360710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:11.361443 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:11.361897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:11.362321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:11.482504 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lazy-loading 'services' on Instance uuid 12163066-5037-46d7-8e66-c900aead6e69 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:34:11.744889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-59090750-cc32-4f1b-b79b-ac9b6b9262fb tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/os-volume_attachments/602e87cf-e58d-4b16-a68a-06e5e72c9c27" status: 202 len: 0 microversion: 2.1 time: 0.396572 Aug 05 15:34:11.745406 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 186/357] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:34:11 2022] DELETE /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/os-volume_attachments/602e87cf-e58d-4b16-a68a-06e5e72c9c27 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:34:12.079263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:12.079873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:12.086344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:12.087426 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:12.087867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:12.088596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:12.089056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:12.089483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:12.220731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:12.229189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:12.230686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:12.231831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b9f4d1ee-5ec2-4282-9c4a-bbd2828eac5a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.156464 Aug 05 15:34:12.232423 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 172/358] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:12 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:13.256174 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:13.256895 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:13.263504 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:13.266319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:13.266319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:13.266319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:13.266319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:13.266660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:13.396367 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:13.398677 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:13.405954 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:13.406484 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:13.406927 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:13.407687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:13.408186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:13.408674 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:13.413086 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:13.421090 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:13.422804 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:13.424267 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5b14f0ba-93f6-497b-89b3-fc6631586e8c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.172991 Aug 05 15:34:13.433049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lazy-loading 'flavor' on Instance uuid 110f9b00-a9dd-4382-8bee-6dafd1756b9e {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:34:13.436490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 187/359] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:13 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:13.813401 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e99178f6-dec5-487c-a459-8052b6618c39 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/action" status: 200 len: 32 microversion: 2.1 time: 0.422231 Aug 05 15:34:13.814000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 173/360] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:34:13 2022] POST /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 15:34:13.824655 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:13.825922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:13.832044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:13.832550 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:13.832984 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:13.833717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:13.834171 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:13.834609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:13.980489 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:13.989760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6d07c96b-f3ab-4822-b56c-09f3bf97ba71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.169803 Aug 05 15:34:13.990427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 188/361] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:13 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:14.448979 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:14.449715 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:14.456034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:14.456635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:14.457071 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:14.457771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:14.458220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:14.458645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:14.593502 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:14.601955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:14.604140 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:14.605322 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-107d47de-a584-40c1-b14b-7da04dc440ca tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.161400 Aug 05 15:34:14.605875 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 174/362] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:14 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:14.980449 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-34edb97f-61e0-4fff-9e37-e4d5068a8307 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:14.986992 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-34edb97f-61e0-4fff-9e37-e4d5068a8307 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:14.987469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-34edb97f-61e0-4fff-9e37-e4d5068a8307 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:14.987907 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-34edb97f-61e0-4fff-9e37-e4d5068a8307 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:15.011471 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:15.012193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:15.018167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:15.018722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:15.019224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:15.019995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:15.020533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:15.021021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:15.048434 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-34edb97f-61e0-4fff-9e37-e4d5068a8307 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Going to try to stop instance {{(pid=118723) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 15:34:15.148007 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:15.156448 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4f46caab-ad8e-4570-aa0c-66b3421d9a21 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.148835 Aug 05 15:34:15.156650 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 175/363] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:15 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:34:15.201484 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-34edb97f-61e0-4fff-9e37-e4d5068a8307 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/action" status: 202 len: 0 microversion: 2.1 time: 0.224649 Aug 05 15:34:15.202023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 189/364] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:34:14 2022] POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:34:15.209999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:15.210609 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:15.216607 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:15.217089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:15.217525 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:15.218209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:15.218662 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:15.219084 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:15.350742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:15.364682 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7be7b4e9-77c7-4c8a-a834-7be2c7b34b99 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.158370 Aug 05 15:34:15.365489 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 176/365] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:15 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:15.514751 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-cd9eaac3-c0b2-464e-aed6-9d6d058c0b12 req-2cc111d2-4e23-49e3-a8eb-f3803aa12c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c377a731-4e6f-47c0-96f5-1b3e2237897d", "name": "network-vif-plugged", "status": "completed", "tag": "a7e56405-70bc-42da-933f-8a3780bd6a0f"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:15.524345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cd9eaac3-c0b2-464e-aed6-9d6d058c0b12 req-2cc111d2-4e23-49e3-a8eb-f3803aa12c0c service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:15.524814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cd9eaac3-c0b2-464e-aed6-9d6d058c0b12 req-2cc111d2-4e23-49e3-a8eb-f3803aa12c0c service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:15.525260 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cd9eaac3-c0b2-464e-aed6-9d6d058c0b12 req-2cc111d2-4e23-49e3-a8eb-f3803aa12c0c service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:15.535892 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-cd9eaac3-c0b2-464e-aed6-9d6d058c0b12 req-2cc111d2-4e23-49e3-a8eb-f3803aa12c0c service nova] Creating event network-vif-plugged:a7e56405-70bc-42da-933f-8a3780bd6a0f for instance c377a731-4e6f-47c0-96f5-1b3e2237897d on hv-cinder-84989 Aug 05 15:34:15.541210 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-cd9eaac3-c0b2-464e-aed6-9d6d058c0b12 req-2cc111d2-4e23-49e3-a8eb-f3803aa12c0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030553 Aug 05 15:34:15.541777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 190/366] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:34:15.630014 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:15.630638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:15.637191 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:15.637668 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:15.638093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:15.638776 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:15.639220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:15.639635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:15.764010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:15.772374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:15.773849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:15.775021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-72b41bfc-1a48-4178-8b25-ca49208a4d9e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.148926 Aug 05 15:34:15.775564 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 177/367] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:15 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:34:16.178847 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:16.179542 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:16.186059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:16.186536 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:16.186971 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:16.187685 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:16.188166 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:16.188590 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:16.321843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:16.329714 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fb883c37-521b-4a28-a8a9-b1005f0bee4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.155677 Aug 05 15:34:16.330272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 191/368] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:16 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:16.386192 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:16.386795 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:16.392609 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:16.393080 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:16.393513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:16.394187 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:16.394630 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:16.395047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:16.523049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:16.530512 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a5569d89-1dbf-4434-83da-f41042575eb9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.148188 Aug 05 15:34:16.531065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 178/369] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:16 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:34:16.798441 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:16.799039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:16.804862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:16.805337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:16.805769 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:16.806449 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:16.806897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:16.807315 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:16.933250 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:16.942236 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:16.944203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:16.944969 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0b701dd4-e0dc-4593-8319-e38c41848df2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.150465 Aug 05 15:34:16.945527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 192/370] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:16 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:17.351486 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:17.352123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:17.358754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:17.359235 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:17.359670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:17.360383 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:17.360841 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:17.361265 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:17.491431 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:17.499892 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e05cd70a-18be-457a-9508-7929d2357db5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.152939 Aug 05 15:34:17.500728 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 179/371] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:17 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:17.551524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:17.552167 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:17.559288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:17.559774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:17.560267 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:17.560960 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:17.561416 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:17.561840 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:17.692750 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:17.700853 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3e44e597-8dff-48e8-aa93-d9625828fff2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.153139 Aug 05 15:34:17.702051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 193/372] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:17 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:17.968468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:17.969170 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:17.975832 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:17.976530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:17.977118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:17.978636 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:17.979090 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:17.979512 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:18.112005 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:18.114605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:18.121531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:18.123041 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:18.124192 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-79552cb5-f127-4929-acbf-0d10a804bafb tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1809 microversion: 2.20 time: 0.159804 Aug 05 15:34:18.129653 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 180/373] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:17 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:18.522442 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:18.523045 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:18.529768 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:18.530246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:18.530685 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:18.531378 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:18.531857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:18.532300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:18.675146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:18.683360 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-587457fc-0193-4105-bbd7-b958f193b21d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.165040 Aug 05 15:34:18.683867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 194/374] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:18 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:18.722800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:18.723410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:18.730104 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:18.735440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:18.735440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:18.735440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:18.735440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:18.735863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:18.861651 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:18.869519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-caff9446-2093-476c-be34-c3114d8ac3ec tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.150835 Aug 05 15:34:18.870079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 181/375] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:18 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:19.147517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:19.148142 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:19.154590 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:19.155069 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:19.155508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:19.156214 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:19.156670 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:19.157093 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:19.286749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:19.294972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:19.296498 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:19.297645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5d7b0a85-3673-420d-8e61-759539a7ee45 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1796 microversion: 2.20 time: 0.154076 Aug 05 15:34:19.298196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 195/376] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:19 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:34:19.711587 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:19.712141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:19.719373 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:19.719851 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:19.720312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:19.720995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:19.721446 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:19.721864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:19.845042 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:19.852832 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-cfe3c874-9a32-4d7b-963d-c58281ea8d4f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.145136 Aug 05 15:34:19.853993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 182/377] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:19 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:19.891035 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:19.891640 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:19.898408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:19.898902 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:19.899320 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:19.900528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:19.900987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:19.901403 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:20.241273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:20.248972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f6f495be-da39-407b-a831-eaa628dbb302 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.362095 Aug 05 15:34:20.249870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 196/378] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:19 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:20.875276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:20.876177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:20.882455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:20.882924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:20.883357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:20.884078 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:20.884572 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:20.884986 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:21.011161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:21.019039 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-bf7d8395-853f-4e55-8ef0-464f50eacd77 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.147599 Aug 05 15:34:21.019590 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 183/379] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:20 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:21.270934 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:21.271534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:21.277854 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:21.278331 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:21.278762 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:21.279446 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:21.279895 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:21.280343 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:21.409192 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:21.411433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:21.417230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9ef9064e-ba7c-4525-9247-e878be0dd347 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.150094 Aug 05 15:34:21.421177 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 197/380] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:21 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:21.600115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:34:21.600286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Fri Aug 5 15:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:34:22.039842 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:22.040469 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:22.047467 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:22.047949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:22.048414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:22.049099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:22.049550 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:22.049973 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:22.175316 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:22.183261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4b0d4f7a-c951-4e45-ae0f-f63bbfafaf66 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.147383 Aug 05 15:34:22.183827 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 184/381] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:22 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:22.440729 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:22.441507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:22.449415 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:22.450288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:22.451166 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:22.452149 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:22.452621 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:22.453055 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:22.589763 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:22.597231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5dc7d440-d87c-4c4b-9b21-cc95544bef78 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.160908 Aug 05 15:34:22.597781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 198/382] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:22 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:23.204644 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:23.205251 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:23.211606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:23.212109 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:23.212545 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:23.213254 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:23.213707 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:23.214130 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:23.341648 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:23.349580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ed930641-8bc7-4a0d-872d-ccfc1e1f5d88 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.148827 Aug 05 15:34:23.350377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 185/383] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:23 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:34:23.618018 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:23.618646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:23.624972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:23.625455 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:23.626145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:23.626836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:23.627289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:23.627713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:23.753715 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:23.761619 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4e8a05ef-ca6d-4648-9d10-67f6791c177d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.147487 Aug 05 15:34:23.762167 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 199/384] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:23 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:24.371791 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:24.372424 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:24.379295 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:24.379811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:24.380274 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:24.380949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:24.381396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:24.381810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:24.511805 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:24.520380 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7541856f-781e-4deb-b0c5-4a1ad0724dd6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.152385 Aug 05 15:34:24.520940 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 186/385] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:24 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:24.782310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:24.782921 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:24.789327 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:24.789806 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:24.790237 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:24.790947 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:24.791399 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:24.791818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:24.916546 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:24.924009 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-932c7d34-6def-49d8-a80a-966611a59877 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1679 microversion: 2.1 time: 0.145513 Aug 05 15:34:24.924592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 200/386] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:24 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:25.542449 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:25.543058 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:25.549601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:25.550115 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:25.550551 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:25.551275 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:25.551727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:25.552177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:25.681430 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:25.689502 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-640ec780-e185-4f4a-b0f1-4b3b4d84f194 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.151355 Aug 05 15:34:25.690074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 187/387] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:25 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:25.945628 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:25.946161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:25.953160 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:25.953646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:25.954083 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:25.954785 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:25.955240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:25.955667 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:26.090124 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:26.097553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-167b4149-a94a-4d41-81ae-84237f3378ee tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1656 microversion: 2.1 time: 0.155900 Aug 05 15:34:26.098099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 201/388] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:25 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:26.117685 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-923c89a6-7f9e-4a4a-b8c3-d6e2efe75fc4 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:26.123565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-923c89a6-7f9e-4a4a-b8c3-d6e2efe75fc4 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:26.124038 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-923c89a6-7f9e-4a4a-b8c3-d6e2efe75fc4 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:26.124509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-923c89a6-7f9e-4a4a-b8c3-d6e2efe75fc4 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:26.146231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-923c89a6-7f9e-4a4a-b8c3-d6e2efe75fc4 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Going to try to start instance {{(pid=118722) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 15:34:26.317431 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-923c89a6-7f9e-4a4a-b8c3-d6e2efe75fc4 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/action" status: 202 len: 0 microversion: 2.1 time: 0.202945 Aug 05 15:34:26.318025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 188/389] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:34:26 2022] POST /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:34:26.326727 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:26.327343 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:26.333619 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:26.334116 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:26.334587 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:26.335325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:26.335785 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:26.338922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:26.476842 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:26.484278 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-966f53fd-2100-47e2-8866-27aaa4ab4b40 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1665 microversion: 2.1 time: 0.161897 Aug 05 15:34:26.484846 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 202/390] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:26 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:26.714237 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:26.714930 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:26.722642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:26.723122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:26.723561 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:26.724290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:26.724742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:26.725521 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:26.860270 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:26.868530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f946b4b4-e2df-4ac9-959d-6cccf3753a41 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.158589 Aug 05 15:34:26.869181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 189/391] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:26 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:27.505897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:27.506509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:27.508823 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=62 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:27.513972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:27.514458 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:27.514890 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:27.515582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:27.516039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:27.519038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:27.645690 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:27.653039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-50a1677a-f203-4274-bfc0-6aabf53870aa tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1665 microversion: 2.1 time: 0.151316 Aug 05 15:34:27.654256 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 203/392] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:27 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:27.891371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:27.891975 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:27.898447 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:27.898935 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:27.899375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:27.900096 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:27.900543 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:27.900966 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:28.034908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:28.042567 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-29a4e465-4890-45a6-8033-2119af106879 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.155777 Aug 05 15:34:28.043137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 190/393] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:27 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:28.675409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:28.675952 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:28.682255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:28.682731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:28.683161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:28.683841 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:28.684313 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:28.684802 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:28.810890 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:28.818173 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a66c7955-2187-48bd-af86-e8dc8ca6b1b2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1669 microversion: 2.1 time: 0.146766 Aug 05 15:34:28.818726 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 204/394] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:28 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1669 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:29.064588 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:29.065198 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:29.071580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:29.072080 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:29.072543 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:29.073231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:29.073689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:29.074118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:29.201197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:29.209083 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ec09f015-5fc4-4606-b54c-26872c04a050 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.149833 Aug 05 15:34:29.209583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 191/395] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:29 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:30.230651 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:30.231261 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:30.237713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:30.238194 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:30.238632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:30.239322 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:30.239775 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:30.240224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:30.368149 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:30.376544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1be97296-af84-4067-8503-2bd46416a610 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.149716 Aug 05 15:34:30.377361 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 205/396] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:30 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:31.398136 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:31.398749 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:31.405377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:31.406473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:31.406905 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:31.407616 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:31.408076 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:31.408509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:31.531396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:31.539155 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d7e68117-99d5-4e12-9a35-bf5e432d213d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.144927 Aug 05 15:34:31.539714 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 192/397] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:31 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:32.560233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:32.560839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:32.566889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:32.567405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:32.571941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:32.571941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:32.571941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:32.571941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:32.706904 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:32.714922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-46f4c1dc-47b2-44ab-82ee-b2efd65d6344 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1736 microversion: 2.1 time: 0.158540 Aug 05 15:34:32.715587 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 206/398] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:32 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:33.737554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:33.738159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:33.744725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:33.745209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:33.745646 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:33.746338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:33.746793 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:33.747222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:33.873567 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:33.881713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f86d3655-6dee-482a-98fc-3aa6e34a4834 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1716 microversion: 2.1 time: 0.148696 Aug 05 15:34:33.882269 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 193/399] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:33 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:33.990684 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:33.991147 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:33.997807 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:33.998280 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:33.998709 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:33.999391 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:33.999846 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:34.000304 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:34.089843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] HTTP exception thrown: Cannot 'detach_volume' instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e while it is in vm_state rescued Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Request method failure captured: Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: DELETE /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments/310b6d1e-5dc3-436b-85ae-532f92f38954 HTTP/1.1 Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TeyvX6nv2b1b8Cp3qCnIQE1DTuxuqUOIFE8kIGCHP9No9BBdDY6X3kSB7FmWI_1Az8YDMKeMFiKHBo9co4NJQuTnEuPXyjbBeZ9e34AeBB2i8xIOo8qY2aaI8qHymt6hMOr_5O5a2vDmRtWc1JnsfKMfaY_QfZAYF-4ujPrWLQNxcw Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:34:34.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1cb48dbd26c747d290bf3e666e65027a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1cb48dbd26c747d290bf3e666e65027a"}]}] Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: cb055110c77543c1861dfd8c155d7582 Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:34:34.093049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Cannot 'detach_volume' instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e while it is in vm_state rescued Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'server_id': '110f9b00-a9dd-4382-8bee-6dafd1756b9e', 'id': '310b6d1e-5dc3-436b-85ae-532f92f38954'} Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:34:34.094363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e while it is in vm_state rescued Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e while it is in vm_state rescued Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:34:34.095877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Returning 409 to user: Cannot 'detach_volume' instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e while it is in vm_state rescued {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:34:34.097280 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6a471b15-8a56-46fe-82e0-b70ebff38769 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "DELETE /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments/310b6d1e-5dc3-436b-85ae-532f92f38954" status: 409 len: 152 microversion: 2.1 time: 0.106324 Aug 05 15:34:34.097280 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 207/400] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:34:33 2022] DELETE /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments/310b6d1e-5dc3-436b-85ae-532f92f38954 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 15:34:34.102909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:34.103928 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:34.110545 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:34.111030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:34.111467 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:34.112187 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:34.112682 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:34.113108 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:34.323102 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-70d0bb41-c800-43d3-8677-80f9c9ce01b6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "POST /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.224509 Aug 05 15:34:34.323795 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 194/401] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:34:34 2022] POST /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:34:34.332582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:34.333547 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:34.339146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:34.339636 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:34.340182 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:34.340796 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:34.341248 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:34.341670 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:34.473881 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:34.481843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7cc1525f-44b8-426c-b004-6a4596da7652 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1724 microversion: 2.1 time: 0.153835 Aug 05 15:34:34.482411 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 208/402] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:34 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:35.504554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:35.505156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:35.511871 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:35.512386 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:35.512816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:35.513496 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:35.513945 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:35.514364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:35.529088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:35.649286 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:35.657847 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e79a7e6f-710c-4f91-9e8e-ac4cf83353f8 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1724 microversion: 2.1 time: 0.158494 Aug 05 15:34:35.658413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 195/403] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:35 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:36.679025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:36.679634 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:36.686114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:36.686595 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:36.687037 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:36.687726 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:36.688203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:36.688628 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:36.816897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:36.824720 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c23a1c3d-aab9-4e6c-932c-61df759349e1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1724 microversion: 2.1 time: 0.149630 Aug 05 15:34:36.825276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 209/404] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:36 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:37.847241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:37.847827 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:37.850174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=54 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:37.854866 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:37.855337 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:37.859638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:37.859638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:37.859638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:37.859638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:37.988253 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:37.997307 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1417bbee-003a-4921-9611-3eeb2c7f48db tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1730 microversion: 2.1 time: 0.154488 Aug 05 15:34:37.997869 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 196/405] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:34:37 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:38.018551 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:38.019046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:38.025376 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:38.025856 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:38.026289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:38.026977 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:38.027432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:38.027859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:38.112432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-abedc4cf-e05c-4b59-ad65-e7930c2e3d17 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098044 Aug 05 15:34:38.113125 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 210/406] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 15:34:38 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:34:39.036702 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-8e728ae5-7b0c-4a87-bc0b-dc4b7848b06b req-61f0dd25-3200-42b5-bd18-96ceae8363f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110f9b00-a9dd-4382-8bee-6dafd1756b9e", "tag": "90dc2636-6d0d-4dc4-ab72-df8554ef6ebc"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:39.048897 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-8e728ae5-7b0c-4a87-bc0b-dc4b7848b06b req-61f0dd25-3200-42b5-bd18-96ceae8363f8 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:39.053174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-8e728ae5-7b0c-4a87-bc0b-dc4b7848b06b req-61f0dd25-3200-42b5-bd18-96ceae8363f8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:39.053174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-8e728ae5-7b0c-4a87-bc0b-dc4b7848b06b req-61f0dd25-3200-42b5-bd18-96ceae8363f8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:39.062624 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-8e728ae5-7b0c-4a87-bc0b-dc4b7848b06b req-61f0dd25-3200-42b5-bd18-96ceae8363f8 service nova] Creating event network-changed:90dc2636-6d0d-4dc4-ab72-df8554ef6ebc for instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e on hv-cinder-84989 Aug 05 15:34:39.067696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-8e728ae5-7b0c-4a87-bc0b-dc4b7848b06b req-61f0dd25-3200-42b5-bd18-96ceae8363f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034945 Aug 05 15:34:39.068312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 197/407] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:34:41.083097 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-b29db8ca-038a-4238-a48b-a071e54c246a req-cd149a3a-336c-4601-ae0f-b2c3bde8b119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110f9b00-a9dd-4382-8bee-6dafd1756b9e", "tag": "90dc2636-6d0d-4dc4-ab72-df8554ef6ebc"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:34:41.092514 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-b29db8ca-038a-4238-a48b-a071e54c246a req-cd149a3a-336c-4601-ae0f-b2c3bde8b119 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:41.092984 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-b29db8ca-038a-4238-a48b-a071e54c246a req-cd149a3a-336c-4601-ae0f-b2c3bde8b119 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:41.093407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-b29db8ca-038a-4238-a48b-a071e54c246a req-cd149a3a-336c-4601-ae0f-b2c3bde8b119 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:41.104910 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-b29db8ca-038a-4238-a48b-a071e54c246a req-cd149a3a-336c-4601-ae0f-b2c3bde8b119 service nova] Creating event network-changed:90dc2636-6d0d-4dc4-ab72-df8554ef6ebc for instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e on hv-cinder-84989 Aug 05 15:34:41.109756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-b29db8ca-038a-4238-a48b-a071e54c246a req-cd149a3a-336c-4601-ae0f-b2c3bde8b119 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031393 Aug 05 15:34:41.110408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 211/408] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:34:57.892467 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:57.893214 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=11 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:57.898064 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:57.898643 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:57.904596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:57.906569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:57.906569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:57.906569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:57.906848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:57.907034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:57.937169 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-fb10e8ab-5889-4461-a896-4236f020d751 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments/d3cbda83-bb9e-4f85-b425-983bd6ba0f4a" status: 200 len: 194 microversion: 2.20 time: 0.046410 Aug 05 15:34:57.937737 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 198/409] 10.222.0.40 () {60 vars in 1454 bytes} [Fri Aug 5 15:34:57 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments/d3cbda83-bb9e-4f85-b425-983bd6ba0f4a => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:34:58.001923 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=17 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:58.002675 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=79 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:34:58.007614 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:58.008233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:58.014103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:58.016961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:58.016961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:58.016961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:58.016961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:58.017314 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:58.096451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lazy-loading 'services' on Instance uuid c377a731-4e6f-47c0-96f5-1b3e2237897d {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:34:58.270126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5885493d-8cb9-438b-9476-cbd0cc8396b8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments/d3cbda83-bb9e-4f85-b425-983bd6ba0f4a" status: 202 len: 0 microversion: 2.20 time: 0.269860 Aug 05 15:34:58.270787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 212/410] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Aug 5 15:34:57 2022] DELETE /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments/d3cbda83-bb9e-4f85-b425-983bd6ba0f4a => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:34:58.279446 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:58.281634 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:58.287804 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:58.288312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:58.288746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:58.289428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:58.289885 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:58.290298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:58.319916 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-251261a7-372c-46f2-af3b-12b1d6a01fdd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044799 Aug 05 15:34:58.320483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 199/411] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 5 15:34:58 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:34:59.334141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:59.336300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:59.342399 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:59.342877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:59.343312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:59.343993 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:59.344515 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:59.344939 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:59.377156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-610bd110-dbcd-4ebf-91f4-0eeb60752040 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047369 Aug 05 15:34:59.377156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 213/412] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 5 15:34:59 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:34:59.439653 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:59.440226 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:59.447173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:59.447651 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:59.448106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:59.448831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:59.449284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:59.449710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:59.474955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:34:59.791268 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-294547c9-b273-4afe-8c30-ee03ecc58801 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 204 len: 0 microversion: 2.20 time: 0.355122 Aug 05 15:34:59.791888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 200/413] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 5 15:34:59 2022] DELETE /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 15:34:59.801262 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:34:59.802387 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:34:59.808366 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:59.808849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:59.809290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:59.809983 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:34:59.810438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:34:59.810863 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:34:59.948736 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:59.956758 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:59.958261 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:34:59.959407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0fd34fed-bdae-4c56-9f5c-3618a8825b3a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.162026 Aug 05 15:34:59.959962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 214/414] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:34:59 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:00.984640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:00.985337 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:00.991672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:00.992190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:00.992651 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:00.993341 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:00.993790 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:00.994212 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:01.119338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:01.127202 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:01.128739 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:01.130494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0d76848e-0f9c-423b-b7ec-0f3c6c81d183 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.150625 Aug 05 15:35:01.131284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 201/415] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:00 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:02.154486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:02.155685 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:02.162870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:02.163355 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:02.163840 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:02.168780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:02.168780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:02.168780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:02.306450 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:02.314964 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:02.316597 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:02.318491 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a94ab55a-98b9-4f64-ad60-b8eaf9739531 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1724 microversion: 2.20 time: 0.168725 Aug 05 15:35:02.319048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 215/416] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:02 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:02.705050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-f26a4fa2-6d23-49aa-9a6b-cdfb67683c9c req-48070d1c-3eca-474e-9c66-e09e9cb841ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c377a731-4e6f-47c0-96f5-1b3e2237897d", "name": "network-vif-deleted", "tag": "a7e56405-70bc-42da-933f-8a3780bd6a0f"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:02.716576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f26a4fa2-6d23-49aa-9a6b-cdfb67683c9c req-48070d1c-3eca-474e-9c66-e09e9cb841ea service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:02.722574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f26a4fa2-6d23-49aa-9a6b-cdfb67683c9c req-48070d1c-3eca-474e-9c66-e09e9cb841ea service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:02.722574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f26a4fa2-6d23-49aa-9a6b-cdfb67683c9c req-48070d1c-3eca-474e-9c66-e09e9cb841ea service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:02.730498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-f26a4fa2-6d23-49aa-9a6b-cdfb67683c9c req-48070d1c-3eca-474e-9c66-e09e9cb841ea service nova] Creating event network-vif-deleted:a7e56405-70bc-42da-933f-8a3780bd6a0f for instance c377a731-4e6f-47c0-96f5-1b3e2237897d on hv-cinder-84989 Aug 05 15:35:02.735562 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-f26a4fa2-6d23-49aa-9a6b-cdfb67683c9c req-48070d1c-3eca-474e-9c66-e09e9cb841ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034705 Aug 05 15:35:02.736276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 202/417] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:03.343434 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:03.344779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:03.352533 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:03.353417 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:03.353866 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:03.354930 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:03.355395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:03.355819 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:03.388498 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:03.389126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:03.389576 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:03.390033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lazy-loading 'fault' on Instance uuid c377a731-4e6f-47c0-96f5-1b3e2237897d {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:35:03.437302 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:03.446792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:03.447377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:03.448660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-16bac9ab-5486-4a50-9d4f-8013939a81e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 200 len: 1372 microversion: 2.20 time: 0.110202 Aug 05 15:35:03.449359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 216/418] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:03 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:04.474155 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:04.474770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:04.480912 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:04.481387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:04.481820 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:04.482510 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:04.482959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:04.483379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:04.496321 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] HTTP exception thrown: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Request method failure captured: Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d HTTP/1.1 Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te-Eaah6-vbJaoP3c-qKWtztwg6AT1xr6i3V75WXkkP0vWwEB_9fbgKBqy0Dz_YbisLLht6fk2CSnwe6ZdaYFcmUtR53apoJaMoIPCk9tetVNHSqu4ySe_skgl-UXmeivrmHM_0df1CdvLZhTUN75Yyn9WNore-ERWu60iSefre9Ko Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:35:04.497919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_648f7ac8fb934441b6782d00d0b5ef10", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/648f7ac8fb934441b6782d00d0b5ef10"}]}] Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: d36b38a6e2d34c41b827ff6db9742332 Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:35:04.499554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'c377a731-4e6f-47c0-96f5-1b3e2237897d'} Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:35:04.500777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:35:04.502249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:04.503614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Returning 404 to user: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:35:04.503614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2604250c-d38b-4181-ba7d-0299f066aaa6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 404 len: 111 microversion: 2.20 time: 0.029991 Aug 05 15:35:04.503614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 203/419] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:04 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:35:04.508759 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-944cbc03-2ea6-4ca4-924f-734304663d46 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '.version_select at 0x7fcb14efca60>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:04.587227 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-944cbc03-2ea6-4ca4-924f-734304663d46 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204001639" status: 204 len: 0 microversion: 2.20 time: 0.082966 Aug 05 15:35:04.587781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 217/420] 10.222.0.40 () {60 vars in 1262 bytes} [Fri Aug 5 15:35:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204001639 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 15:35:05.387978 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1a9eada9-01c4-4ff6-8b5e-516039c2689a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'create', calling method: .version_select at 0x7fcb14ef6b80>, body: {"keypair": {"name": "tempest-keypair-902446733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmy/l2Wst9aihbFGZrebHcG/K3Kr5u1+8vk5zQKFEWLq2kNJic8ITmBawJhrYsl2MtgHW8J37LaFSaA5VF8m1ydTlpjeXp1Mz61v6UMuPNG/7RLlQLyaLfWeVwBxglNPA=="}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:05.402954 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-1a9eada9-01c4-4ff6-8b5e-516039c2689a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Getting quotas for project 648f7ac8fb934441b6782d00d0b5ef10. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:35:05.406808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-1a9eada9-01c4-4ff6-8b5e-516039c2689a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Getting quotas for user d36b38a6e2d34c41b827ff6db9742332 and project 648f7ac8fb934441b6782d00d0b5ef10. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:35:05.524404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1a9eada9-01c4-4ff6-8b5e-516039c2689a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.140264 Aug 05 15:35:05.525031 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 204/421] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Aug 5 15:35:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 15:35:07.272480 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:07.274681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:07.280666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:07.281194 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:07.281638 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:07.282332 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:07.282787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:07.283236 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:07.313181 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-79b44110-ade1-4617-8778-c1312bffaa27 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046296 Aug 05 15:35:07.313987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 218/422] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:35:07 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 15:35:07.379088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:07.379533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:07.390191 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:07.391123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:07.391123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:07.391803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:07.392284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:07.392707 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:07.417882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:35:07.577303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1410240372", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c44331f6-946f-4f51-8016-9a872c1f5969"}], "security_groups": [{"name": "tempest-securitygroup--495536906"}], "key_name": "tempest-keypair-902446733", "user_data": "}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:07.681509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] validate_networks() for [('c44331f6-946f-4f51-8016-9a872c1f5969', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:35:07.729678 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-832674d8-ef92-4692-8421-3a53b32af393 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 204 len: 0 microversion: 2.1 time: 0.354303 Aug 05 15:35:07.730815 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 205/423] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:35:07 2022] DELETE /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:35:07.739282 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:07.739978 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:07.745931 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:07.750757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:07.750757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:07.750757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:07.750757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:07.751153 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:07.935569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:07.943079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-aaee08dc-9e1f-40e7-baac-281bb9e6bdb5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1675 microversion: 2.1 time: 0.207886 Aug 05 15:35:07.943644 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 206/424] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:07 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:35:08.101345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:35:08.101773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:35:08.102250 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:35:08.102662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:35:08.103078 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:35:08.111857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:08.112371 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:08.112809 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:08.113543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:08.113995 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:08.114419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:08.131888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Getting quotas for project 648f7ac8fb934441b6782d00d0b5ef10. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:35:08.136134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Getting quotas for user d36b38a6e2d34c41b827ff6db9742332 and project 648f7ac8fb934441b6782d00d0b5ef10. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:35:08.149854 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:35:08.152649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:35:08.263863 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d307e242-aa34-4ea4-af31-590d1520fce8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.690738 Aug 05 15:35:08.264653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 219/425] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Aug 5 15:35:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 05 15:35:08.275255 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-55bb11ab-f17e-49d0-8720-e43a2e455338 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:08.275867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-55bb11ab-f17e-49d0-8720-e43a2e455338 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:08.328658 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-55bb11ab-f17e-49d0-8720-e43a2e455338 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:08.336009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-55bb11ab-f17e-49d0-8720-e43a2e455338 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:08.337565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-55bb11ab-f17e-49d0-8720-e43a2e455338 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:08.338640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-55bb11ab-f17e-49d0-8720-e43a2e455338 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1281 microversion: 2.20 time: 0.067266 Aug 05 15:35:08.339208 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 207/426] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:08 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:08.964649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:08.965256 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:08.972245 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:08.972726 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:08.979828 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:08.979828 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:08.979828 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:08.979828 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:09.100437 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:09.109103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c27e453d-18b4-4670-989e-b390884b7e82 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1675 microversion: 2.1 time: 0.148957 Aug 05 15:35:09.109694 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 220/427] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:08 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:09.361530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:09.362045 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:09.368983 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:09.369452 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:09.369879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:09.370555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:09.371000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:09.371415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:09.439525 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:09.448276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:09.449773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:09.450864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c7fbcbfb-f1b8-4879-bd42-900b1f81734b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1285 microversion: 2.20 time: 0.093416 Aug 05 15:35:09.451413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 208/428] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:09 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:10.130926 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:10.131444 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:10.138078 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:10.138562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:10.139003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:10.139694 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:10.140175 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:10.140601 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:10.473228 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:10.473822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:10.481148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:10.481811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:10.482251 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:10.482958 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:10.483083 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:10.483409 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:10.483829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:10.491490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-837b9b67-03c5-422e-a1b8-bc7663b74791 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1675 microversion: 2.1 time: 0.364480 Aug 05 15:35:10.492054 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 221/429] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:10 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1675 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:35:10.553238 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:10.563053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:10.564854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:10.565960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-6a95d707-371a-4147-98b0-8170cc79fe95 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1333 microversion: 2.20 time: 0.096680 Aug 05 15:35:10.566527 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 209/430] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:10 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:35:11.005317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-49095994-498f-4883-a24a-41313869b858 req-3c9604c7-7f20-4767-b7b2-276a8cd1957f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12163066-5037-46d7-8e66-c900aead6e69", "name": "network-vif-deleted", "tag": "3bde49ef-58cd-4efe-9d08-24840f0c6502"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:11.029255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-49095994-498f-4883-a24a-41313869b858 req-3c9604c7-7f20-4767-b7b2-276a8cd1957f service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:11.029755 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-49095994-498f-4883-a24a-41313869b858 req-3c9604c7-7f20-4767-b7b2-276a8cd1957f service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:11.030215 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-49095994-498f-4883-a24a-41313869b858 req-3c9604c7-7f20-4767-b7b2-276a8cd1957f service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:11.051553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-49095994-498f-4883-a24a-41313869b858 req-3c9604c7-7f20-4767-b7b2-276a8cd1957f service nova] Creating event network-vif-deleted:3bde49ef-58cd-4efe-9d08-24840f0c6502 for instance 12163066-5037-46d7-8e66-c900aead6e69 on hv-cinder-84989 Aug 05 15:35:11.066986 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-49095994-498f-4883-a24a-41313869b858 req-3c9604c7-7f20-4767-b7b2-276a8cd1957f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065134 Aug 05 15:35:11.067598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 222/431] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:11.514893 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:11.516204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:11.522403 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:11.522886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:11.523320 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:11.524241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:11.524731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:11.525159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:11.557082 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:11.557775 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:11.558371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:11.558990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lazy-loading 'fault' on Instance uuid 12163066-5037-46d7-8e66-c900aead6e69 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:35:11.590109 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:11.590805 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:11.605101 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:11.605585 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:11.606648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:11.607541 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:11.608198 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:11.608766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:11.609017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:11.617010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-570891df-1c71-4bb8-b662-f7333d348f9d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 200 len: 1327 microversion: 2.1 time: 0.105858 Aug 05 15:35:11.617813 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 210/432] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:11 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:11.790114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:11.798862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:11.801094 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:11.802598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4f018022-be90-4038-bf5c-660000eef86e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1406 microversion: 2.20 time: 0.216976 Aug 05 15:35:11.803671 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 223/433] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:11 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:35:12.639271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:12.639872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:12.647211 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:12.647852 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:12.648172 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:12.648893 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:12.649348 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:12.650494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:12.664311 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] HTTP exception thrown: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Request method failure captured: Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 HTTP/1.1 Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te8lLG7j7jKnAWh-6EqFNESlZhodfu1PKUmepHO7I3lSbnDKVHUdhb1IhI30wSE0uo9vAvgu0Xz5pTmCeDRgTeOl1944zcS0qQMwD403tEGtDpqE4nXLTvLqPt4Djfi3O0GPU9nw3qUoRvjXfbK4lq4231qR2QV-2uNJd29-DL6YYE Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:35:12.665970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9776de9e6d341fdbf7ac4fa70b994aa", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9776de9e6d341fdbf7ac4fa70b994aa"}]}] Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 04e80222936d4427909414a78e1dc489 Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:35:12.667387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '12163066-5037-46d7-8e66-c900aead6e69'} Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:35:12.668334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:35:12.669706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:12.670868 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Returning 404 to user: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:35:12.670868 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-31b1fedb-5c10-467b-afa2-5a2be4ee4729 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 404 len: 111 microversion: 2.1 time: 0.033277 Aug 05 15:35:12.671861 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 211/434] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:12 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:35:12.680191 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4384c047-907e-4b6b-80e6-7152ad1a9584 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '.version_select at 0x7fcb14d84430>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:12.748669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4384c047-907e-4b6b-80e6-7152ad1a9584 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-506535949" status: 202 len: 0 microversion: 2.1 time: 0.072226 Aug 05 15:35:12.749273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 224/435] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 15:35:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-506535949 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 15:35:12.830766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:12.831372 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:12.838471 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:12.838957 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:12.839395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:12.840104 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:12.840742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:12.841164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:12.989110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:13.001376 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:13.005302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:13.005302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-143ec5dd-acb5-4e1e-9ca5-555683cfccd5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1406 microversion: 2.20 time: 0.177170 Aug 05 15:35:13.005302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 212/436] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:12 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:13.086467 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-12aef5d1-c74f-442d-acf6-e0d52ca9b181 req-00b48fba-2de5-411e-a97c-faee59002364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a10dbd4-0580-46dc-821e-98476c654d5a", "tag": "b7a39fee-4688-4052-adea-986dac23d796"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:13.096560 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-12aef5d1-c74f-442d-acf6-e0d52ca9b181 req-00b48fba-2de5-411e-a97c-faee59002364 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:13.097113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-12aef5d1-c74f-442d-acf6-e0d52ca9b181 req-00b48fba-2de5-411e-a97c-faee59002364 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:13.097606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-12aef5d1-c74f-442d-acf6-e0d52ca9b181 req-00b48fba-2de5-411e-a97c-faee59002364 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:13.107861 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-12aef5d1-c74f-442d-acf6-e0d52ca9b181 req-00b48fba-2de5-411e-a97c-faee59002364 service nova] Creating event network-changed:b7a39fee-4688-4052-adea-986dac23d796 for instance 8a10dbd4-0580-46dc-821e-98476c654d5a on hv-cinder-84989 Aug 05 15:35:13.112751 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-12aef5d1-c74f-442d-acf6-e0d52ca9b181 req-00b48fba-2de5-411e-a97c-faee59002364 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030181 Aug 05 15:35:13.113323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 225/437] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:13.532054 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-47165e4e-4468-4245-8503-e88e6182cc29 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'create', calling method: .version_select at 0x7fcb15802940>, body: {"keypair": {"name": "tempest-keypair-798667578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANIlP4FVPhvbaeM9XvpVeufKrAdxR8qeK9q3rnAyNS3Sc7qlHTeG+XL3yWUc42cEu2eAZOllZLa/j5poDjnxMGwgDjx9s6jzWnk7M6e1wp4x3iS+2SIB/atLPc2Z3XOtg=="}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:13.547993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-47165e4e-4468-4245-8503-e88e6182cc29 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Getting quotas for project f9776de9e6d341fdbf7ac4fa70b994aa. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:35:13.551802 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-47165e4e-4468-4245-8503-e88e6182cc29 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Getting quotas for user 04e80222936d4427909414a78e1dc489 and project f9776de9e6d341fdbf7ac4fa70b994aa. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:35:13.639989 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-47165e4e-4468-4245-8503-e88e6182cc29 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111878 Aug 05 15:35:13.641005 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 213/438] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:35:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:14.028209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:14.028968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:14.035376 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:14.035875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:14.036409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:14.037121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:14.037576 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:14.038000 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:14.177967 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:14.187713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:14.189272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:14.190408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0a35250c-dc09-47b5-a75f-0d2480bd8ad6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1406 microversion: 2.20 time: 0.167138 Aug 05 15:35:14.190959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 226/439] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:14 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:15.214301 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:15.214903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:15.220862 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:15.221350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:15.221789 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:15.222476 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:15.222926 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:15.223348 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:15.414638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:15.423342 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:15.424941 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:15.426026 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1e9b92aa-c877-4cdd-abfb-198db0b68957 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1406 microversion: 2.20 time: 0.216730 Aug 05 15:35:15.426577 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 214/440] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:15 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:16.158155 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-569106527", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5556c147-7063-4e54-b1ad-a45bb656fda4"}], "security_groups": [{"name": "tempest-securitygroup--1037190215"}], "key_name": "tempest-keypair-798667578", "user_data": "}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:16.269837 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] validate_networks() for [('5556c147-7063-4e54-b1ad-a45bb656fda4', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:35:16.448421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:16.449023 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:16.455417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:16.459768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:16.459768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:16.459768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:16.459768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:16.460170 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:16.673576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:16.677102 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:16.682739 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:16.684324 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:16.685512 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9b01aa82-8f07-49da-af45-94cc124c3f89 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1406 microversion: 2.20 time: 0.241003 Aug 05 15:35:16.686219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 215/441] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:16 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:35:16.707157 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:35:16.707581 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:35:16.708053 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:35:16.708493 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:35:16.708917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:35:16.718062 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:16.718539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:16.718971 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:16.719702 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:16.720195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:16.720614 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:16.737717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Getting quotas for project f9776de9e6d341fdbf7ac4fa70b994aa. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:35:16.741612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Getting quotas for user 04e80222936d4427909414a78e1dc489 and project f9776de9e6d341fdbf7ac4fa70b994aa. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:35:16.752351 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:35:16.754536 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:35:16.863310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-59bbe712-8f4f-40d7-b279-bae8f75dbdf3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.709304 Aug 05 15:35:16.863905 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 227/442] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:35:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:35:16.874826 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e01cc7b1-e9c9-47c8-aa98-3b9d92741c70 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:16.875461 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e01cc7b1-e9c9-47c8-aa98-3b9d92741c70 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:16.930957 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e01cc7b1-e9c9-47c8-aa98-3b9d92741c70 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:16.937747 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e01cc7b1-e9c9-47c8-aa98-3b9d92741c70 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1236 microversion: 2.1 time: 0.067074 Aug 05 15:35:16.938620 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 216/443] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:16 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:17.694812 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:17.695343 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:17.704111 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:17.704600 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:17.705229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:17.705925 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:17.706385 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:17.706812 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:17.709031 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:17.709754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:17.715991 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:17.716568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:17.717011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:17.717708 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:17.718162 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:17.718587 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:17.789879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lazy-loading 'services' on Instance uuid 110f9b00-a9dd-4382-8bee-6dafd1756b9e {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:35:17.856969 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:17.865238 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:17.870312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:17.870312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4050cea9-028d-489c-85bb-097fc0014e4b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1406 microversion: 2.20 time: 0.164111 Aug 05 15:35:17.870312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 217/444] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:17 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:35:17.891823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-c189c66e-cb31-4309-baaa-4bf2cda9d811 req-13fe5246-5596-4238-a034-6312c30dd10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a10dbd4-0580-46dc-821e-98476c654d5a", "name": "network-vif-plugged", "status": "completed", "tag": "b7a39fee-4688-4052-adea-986dac23d796"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:17.901289 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c189c66e-cb31-4309-baaa-4bf2cda9d811 req-13fe5246-5596-4238-a034-6312c30dd10d service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:17.901766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c189c66e-cb31-4309-baaa-4bf2cda9d811 req-13fe5246-5596-4238-a034-6312c30dd10d service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:17.902227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c189c66e-cb31-4309-baaa-4bf2cda9d811 req-13fe5246-5596-4238-a034-6312c30dd10d service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:17.913046 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-c189c66e-cb31-4309-baaa-4bf2cda9d811 req-13fe5246-5596-4238-a034-6312c30dd10d service nova] Creating event network-vif-plugged:b7a39fee-4688-4052-adea-986dac23d796 for instance 8a10dbd4-0580-46dc-821e-98476c654d5a on hv-cinder-84989 Aug 05 15:35:17.918684 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-c189c66e-cb31-4309-baaa-4bf2cda9d811 req-13fe5246-5596-4238-a034-6312c30dd10d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 Aug 05 15:35:17.919341 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 218/445] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:35:17.959161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:17.959933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:17.966233 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:17.967857 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:17.967857 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:17.967857 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:17.968305 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:17.968736 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:18.031863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:18.033190 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-58c44d23-4878-44e0-b1de-fb1478a89558 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "DELETE /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments/310b6d1e-5dc3-436b-85ae-532f92f38954" status: 202 len: 0 microversion: 2.1 time: 0.342539 Aug 05 15:35:18.039480 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 228/446] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:35:17 2022] DELETE /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments/310b6d1e-5dc3-436b-85ae-532f92f38954 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:35:18.044816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5ed3174f-abcd-41ac-8ceb-9af788fb8737 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1240 microversion: 2.1 time: 0.089699 Aug 05 15:35:18.045670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 219/447] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:17 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:18.046319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:18.048707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:18.063352 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:18.064086 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:18.064719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:18.065516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:18.066138 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:18.066570 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:18.095682 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ca06d6d4-8a95-4e6a-971c-aa6d0489ad6c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054638 Aug 05 15:35:18.096269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 229/448] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:35:18 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:18.891349 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:18.891964 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:18.898326 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:18.898810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:18.899249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:18.899940 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:18.900491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:18.901573 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:19.034165 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:19.042108 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:19.043596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:19.044710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3fe4f33d-f380-4328-b03a-777c699a06ec tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1406 microversion: 2.20 time: 0.157290 Aug 05 15:35:19.045263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 220/449] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:18 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:19.065321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:19.065963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:19.073465 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:19.073965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:19.074410 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:19.075110 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:19.075617 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:19.076266 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:19.108317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:19.112184 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:19.116545 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:19.117021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:19.117455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:19.118151 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:19.118604 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:19.119025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:19.142017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:19.149135 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2cd3d5b7-2aca-49ee-8e17-4dd8d449dfa5 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Aug 05 15:35:19.149693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 221/450] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:35:19 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:35:19.150688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8fddfe8f-d753-482a-a1a3-20e903fdf315 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1288 microversion: 2.1 time: 0.088368 Aug 05 15:35:19.150688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 230/451] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:19 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:20.070244 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:20.070956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:20.078019 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.078493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.078920 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.079627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.080084 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.080509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.161733 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:20.164091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:20.183820 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.187548 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.187548 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.187548 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.187548 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.187950 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.204731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:20.217672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:20.218310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fc8ae252-3b83-4c0f-b7b8-34f7e843e157 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060966 Aug 05 15:35:20.218888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 231/452] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:35:20 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 15:35:20.228727 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:20.235142 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:20.235891 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.236577 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.237162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.238039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.238644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.239217 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.248274 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:20.250492 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:20.251956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-20e9e956-758e-48a7-81f4-e52d445e954e tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1406 microversion: 2.20 time: 0.185681 Aug 05 15:35:20.252752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 222/453] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:20 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:20.314780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:20.325779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9bd3540a-0c2b-4792-af1e-2d3fd06adfb0 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1296 microversion: 2.1 time: 0.100169 Aug 05 15:35:20.325968 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:20.326277 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 232/454] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:20 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:20.326448 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:20.332448 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.332929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.333365 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.334049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.334494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.334914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.360691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:35:20.650710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f4a4e3e7-e61d-4d4f-9db9-0d566f1d42bb tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "DELETE /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 204 len: 0 microversion: 2.1 time: 0.328783 Aug 05 15:35:20.651580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 223/455] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:35:20 2022] DELETE /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:35:20.660514 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:20.661365 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:20.667959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.668472 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.669510 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.670226 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:20.670686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:20.673005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:20.800985 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:20.808764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5673be4a-febe-45b5-9f22-b8f3ed02360d tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1690 microversion: 2.1 time: 0.152174 Aug 05 15:35:20.809333 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 233/456] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:20 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:21.276898 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:21.277582 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:21.283911 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:21.284421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:21.284851 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:21.285532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:21.285979 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:21.286392 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:21.346855 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:21.347486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:21.353841 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:21.354351 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:21.354791 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:21.355478 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:21.355927 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:21.356395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:21.449252 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:21.457888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:21.459412 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:21.460615 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2ecf5685-2939-45a1-a503-bf40c37352da tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1598 microversion: 2.20 time: 0.188041 Aug 05 15:35:21.461177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 224/457] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:35:21 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1598 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:35:21.482314 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:21.482818 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:21.485794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:21.489135 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:21.489613 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:21.490047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:21.490742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:21.491198 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:21.491625 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:21.506711 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:21.515239 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-acb8afc4-070f-410c-9fa2-d2c3a1005abc tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.172187 Aug 05 15:35:21.515890 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 234/458] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:21 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:35:21.568908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f852c23f-bd1c-4dd7-8906-c4588a05b47b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090304 Aug 05 15:35:21.569489 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 225/459] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Aug 5 15:35:21 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 15:35:21.830027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:21.830690 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:21.836669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:21.837157 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:21.837594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:21.838288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:21.838743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:21.839172 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:22.062376 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:22.070145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ce4c87ce-7d48-4b62-912b-ec40ee0527fe tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1690 microversion: 2.1 time: 0.243943 Aug 05 15:35:22.070999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 235/460] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:21 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:22.541095 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:22.541704 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:22.548189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:22.548778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:22.549220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:22.549932 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:22.550404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:22.550816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:22.868800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-cf9c6de7-9d48-4491-8219-17b9d4dae578 req-17d73720-96d5-42ce-ae01-73d51024e4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a10dbd4-0580-46dc-821e-98476c654d5a", "tag": "b7a39fee-4688-4052-adea-986dac23d796"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:22.880201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:22.880847 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cf9c6de7-9d48-4491-8219-17b9d4dae578 req-17d73720-96d5-42ce-ae01-73d51024e4d9 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:22.881329 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cf9c6de7-9d48-4491-8219-17b9d4dae578 req-17d73720-96d5-42ce-ae01-73d51024e4d9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:22.881762 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cf9c6de7-9d48-4491-8219-17b9d4dae578 req-17d73720-96d5-42ce-ae01-73d51024e4d9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:22.889378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9b64d554-d026-490b-82c8-ffe01ee2cc7d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.352850 Aug 05 15:35:22.889944 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 226/461] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:22 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:22.898000 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-cf9c6de7-9d48-4491-8219-17b9d4dae578 req-17d73720-96d5-42ce-ae01-73d51024e4d9 service nova] Creating event network-changed:b7a39fee-4688-4052-adea-986dac23d796 for instance 8a10dbd4-0580-46dc-821e-98476c654d5a on hv-cinder-84989 Aug 05 15:35:22.904814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-cf9c6de7-9d48-4491-8219-17b9d4dae578 req-17d73720-96d5-42ce-ae01-73d51024e4d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040553 Aug 05 15:35:22.905525 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 236/462] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:35:23.090838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:23.091505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:23.097492 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:23.097973 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:23.098407 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:23.099106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:23.099557 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:23.099978 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:23.228887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:23.237111 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d62f7e9d-040b-4e08-9cd2-b57a932bdd99 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1690 microversion: 2.1 time: 0.150216 Aug 05 15:35:23.237870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 227/463] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:23 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:23.911628 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:23.917881 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:23.919412 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:23.919924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:23.920381 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:23.921074 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:23.921522 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:23.921944 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:24.191641 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:24.199371 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1ea16892-6e30-4e2c-b0ef-b6a50e5a4c34 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.292507 Aug 05 15:35:24.200209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 237/464] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:23 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:24.259484 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:24.261008 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:24.268939 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:24.269423 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:24.269854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:24.270550 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:24.271228 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:24.271646 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:24.528313 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:24.536483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0da8a4db-9b21-4e23-b6be-1beb678f5600 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1690 microversion: 2.1 time: 0.281224 Aug 05 15:35:24.550498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 228/465] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:24 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1690 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:24.650597 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-a9906b49-e928-45e7-b693-79829a09e991 req-60cfd154-00f3-43fc-b991-95c1cbf515c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adba90d0-6910-4741-a3c7-a7fa5ffbda9c", "tag": "c2647432-cbf5-4f2d-a719-a7acfd914103"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:24.662524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a9906b49-e928-45e7-b693-79829a09e991 req-60cfd154-00f3-43fc-b991-95c1cbf515c9 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:24.663006 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a9906b49-e928-45e7-b693-79829a09e991 req-60cfd154-00f3-43fc-b991-95c1cbf515c9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:24.663465 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a9906b49-e928-45e7-b693-79829a09e991 req-60cfd154-00f3-43fc-b991-95c1cbf515c9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:24.675727 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-a9906b49-e928-45e7-b693-79829a09e991 req-60cfd154-00f3-43fc-b991-95c1cbf515c9 service nova] Creating event network-changed:c2647432-cbf5-4f2d-a719-a7acfd914103 for instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c on hv-cinder-84989 Aug 05 15:35:24.682040 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-a9906b49-e928-45e7-b693-79829a09e991 req-60cfd154-00f3-43fc-b991-95c1cbf515c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035035 Aug 05 15:35:24.682662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 238/466] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:25.087552 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-6b86c01d-e576-47bb-a30e-5dcad359bd18 req-ac8b7118-c371-4ee1-b94f-8f2401b77710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110f9b00-a9dd-4382-8bee-6dafd1756b9e", "name": "network-vif-deleted", "tag": "90dc2636-6d0d-4dc4-ab72-df8554ef6ebc"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:25.098572 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6b86c01d-e576-47bb-a30e-5dcad359bd18 req-ac8b7118-c371-4ee1-b94f-8f2401b77710 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:25.105003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6b86c01d-e576-47bb-a30e-5dcad359bd18 req-ac8b7118-c371-4ee1-b94f-8f2401b77710 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:25.105003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6b86c01d-e576-47bb-a30e-5dcad359bd18 req-ac8b7118-c371-4ee1-b94f-8f2401b77710 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:25.112269 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-6b86c01d-e576-47bb-a30e-5dcad359bd18 req-ac8b7118-c371-4ee1-b94f-8f2401b77710 service nova] Creating event network-vif-deleted:90dc2636-6d0d-4dc4-ab72-df8554ef6ebc for instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e on hv-cinder-84989 Aug 05 15:35:25.117112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-6b86c01d-e576-47bb-a30e-5dcad359bd18 req-ac8b7118-c371-4ee1-b94f-8f2401b77710 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033274 Aug 05 15:35:25.120746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 229/467] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:25.222700 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:25.223406 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:25.230209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:25.231012 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:25.235891 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:25.237205 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:25.237928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:25.238582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:25.417069 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:25.425280 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5a946605-96a6-4df8-ab09-6f32a8d9529a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.207261 Aug 05 15:35:25.426179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 239/468] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:25 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:25.558465 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:25.559272 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:25.566025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:25.566506 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:25.566945 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:25.567641 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:25.568128 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:25.568559 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:25.600370 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:25.601112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:25.601554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:25.602005 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lazy-loading 'fault' on Instance uuid 110f9b00-a9dd-4382-8bee-6dafd1756b9e {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:35:25.643664 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:25.651051 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-028a0e25-ea4b-437f-a40a-6b49c6864061 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1335 microversion: 2.1 time: 0.096775 Aug 05 15:35:25.651609 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 230/469] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:25 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:26.446501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:26.447045 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:26.453429 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:26.453909 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:26.454342 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:26.455028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:26.455477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:26.455899 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:26.585490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:26.593369 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f70953f9-349c-41da-953d-89acdc7035da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.150914 Aug 05 15:35:26.593939 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 240/470] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:26 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:26.672883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:26.673522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:26.680481 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:26.680970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:26.681407 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:26.682119 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:26.682573 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:26.683230 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:26.714097 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:26.714497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:26.714931 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:26.715375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lazy-loading 'fault' on Instance uuid 110f9b00-a9dd-4382-8bee-6dafd1756b9e {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:35:26.760947 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:26.768980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e28be808-58cb-4a16-a8e4-9f88339a4ee7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 200 len: 1335 microversion: 2.1 time: 0.100635 Aug 05 15:35:26.769895 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 231/471] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:26 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:27.614257 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:27.615529 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:27.617656 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=4 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:27.618495 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=12 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:27.624761 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:27.625282 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:27.627880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:27.627880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:27.627880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:27.627880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:27.755445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:27.763501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8c108e56-1a4c-4dd8-91e3-fc64a3a36d4a tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.153194 Aug 05 15:35:27.764195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 241/472] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:27 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:27.789994 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:27.790896 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 110f9b00-a9dd-4382-8bee-6dafd1756b9e] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:27.793340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=12 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:27.799481 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:27.800046 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:27.801345 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:27.801345 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:27.801679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:27.802104 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:27.816702 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] HTTP exception thrown: Instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e could not be found. Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Request method failure captured: Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e HTTP/1.1 Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TeyvX6nv2b1b8Cp3qCnIQE1DTuxuqUOIFE8kIGCHP9No9BBdDY6X3kSB7FmWI_1Az8YDMKeMFiKHBo9co4NJQuTnEuPXyjbBeZ9e34AeBB2i8xIOo8qY2aaI8qHymt6hMOr_5O5a2vDmRtWc1JnsfKMfaY_QfZAYF-4ujPrWLQNxcw Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:35:27.818377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1cb48dbd26c747d290bf3e666e65027a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1cb48dbd26c747d290bf3e666e65027a"}]}] Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: cb055110c77543c1861dfd8c155d7582 Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e could not be found. Aug 05 15:35:27.819785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '110f9b00-a9dd-4382-8bee-6dafd1756b9e'} Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e could not be found. Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:35:27.821526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e could not be found. Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e could not be found. Aug 05 15:35:27.824239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:27.831224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Returning 404 to user: Instance 110f9b00-a9dd-4382-8bee-6dafd1756b9e could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:35:27.831224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c29e7682-759f-42ab-aa56-79feabaa356c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e" status: 404 len: 111 microversion: 2.1 time: 0.033842 Aug 05 15:35:27.831224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 232/473] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:27 2022] GET /compute/v2.1/servers/110f9b00-a9dd-4382-8bee-6dafd1756b9e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:35:27.831485 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b13507f8-a596-4b77-8afc-eaaa8d1ef921 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '.version_select at 0x7fcb14d7a280>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:27.846477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:27.898096 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b13507f8-a596-4b77-8afc-eaaa8d1ef921 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025074384" status: 202 len: 0 microversion: 2.1 time: 0.072106 Aug 05 15:35:27.898731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 242/474] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 5 15:35:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025074384 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:35:28.786844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:28.787458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:28.793956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:28.795117 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:28.795528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:28.796342 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:28.796696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:28.797116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:28.815131 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:28.929180 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:28.936342 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-987b9c87-932f-4501-8dd3-ac268cfe0a6b tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.154055 Aug 05 15:35:28.936900 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 233/475] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:28 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:35:29.922041 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-780bcc23-51aa-426f-bc8e-3d2e5fa30fd1 req-5ba8d1ef-8288-43f2-abed-3b49635b4378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adba90d0-6910-4741-a3c7-a7fa5ffbda9c", "name": "network-vif-plugged", "status": "completed", "tag": "c2647432-cbf5-4f2d-a719-a7acfd914103"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:29.932523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-780bcc23-51aa-426f-bc8e-3d2e5fa30fd1 req-5ba8d1ef-8288-43f2-abed-3b49635b4378 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:29.932995 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-780bcc23-51aa-426f-bc8e-3d2e5fa30fd1 req-5ba8d1ef-8288-43f2-abed-3b49635b4378 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:29.933419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-780bcc23-51aa-426f-bc8e-3d2e5fa30fd1 req-5ba8d1ef-8288-43f2-abed-3b49635b4378 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:29.944308 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-780bcc23-51aa-426f-bc8e-3d2e5fa30fd1 req-5ba8d1ef-8288-43f2-abed-3b49635b4378 service nova] Creating event network-vif-plugged:c2647432-cbf5-4f2d-a719-a7acfd914103 for instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c on hv-cinder-84989 Aug 05 15:35:29.949382 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-780bcc23-51aa-426f-bc8e-3d2e5fa30fd1 req-5ba8d1ef-8288-43f2-abed-3b49635b4378 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032768 Aug 05 15:35:29.950047 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 243/476] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:29.958336 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:29.958841 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:29.965147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:29.965636 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:29.966069 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:29.966769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:29.967226 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:29.967666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:30.105091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:30.114263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e34897de-b4a0-457c-88d0-1cafea75b027 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.160461 Aug 05 15:35:30.114834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 234/477] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:29 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:31.137438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:31.138134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:31.145092 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:31.145583 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:31.146023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:31.146740 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:31.147180 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:31.147606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:31.148450 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:31.148946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:31.155348 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:31.155816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:31.156278 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:31.156967 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:31.157417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:31.157838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:31.185483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:35:31.281374 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:31.288733 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3cfddf52-3487-4eda-9855-3281b6fc8c56 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1362 microversion: 2.1 time: 0.156581 Aug 05 15:35:31.289302 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 244/478] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:31 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:31.445762 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ff1c40c0-afe0-425f-b85b-130f1a8d0943 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 204 len: 0 microversion: 2.1 time: 0.300808 Aug 05 15:35:31.446353 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 235/479] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:35:31 2022] DELETE /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 15:35:31.454566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:31.455179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:31.461137 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:31.461612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:31.466273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:31.466273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:31.466273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:31.466273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:31.594309 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:31.601732 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-88d1c68a-01cc-4fd8-abbe-f0b38dabf14f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1508 microversion: 2.1 time: 0.151184 Aug 05 15:35:31.605548 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 245/480] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:31 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:35:32.309406 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:32.310092 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:32.316347 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:32.324218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:32.324218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:32.324218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:32.324218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:32.324600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:32.448672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:32.456869 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7bbb284a-8678-42f3-96f3-6af857e2c3e1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1549 microversion: 2.1 time: 0.151617 Aug 05 15:35:32.457429 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 236/481] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:32 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:32.476884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:32.477376 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:32.483783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:32.484348 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:32.484780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:32.485461 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:32.485916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:32.486337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:32.563366 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3de92405-d158-4487-bdc5-e6920fc50228 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090265 Aug 05 15:35:32.564055 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 246/482] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 15:35:32 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:32.623164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:32.623771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:32.631010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:32.631492 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:32.631995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:32.632712 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:32.633161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:32.633579 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:32.875267 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:32.882638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a1c614c6-6b5c-4d12-8549-73892a69876f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1508 microversion: 2.1 time: 0.263465 Aug 05 15:35:32.883201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 237/483] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:32 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:33.604538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-fda380c7-e4bf-4ca9-bd20-ec6d794711fd req-09b08719-eb41-4970-ba3b-99f5de844c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adba90d0-6910-4741-a3c7-a7fa5ffbda9c", "tag": "c2647432-cbf5-4f2d-a719-a7acfd914103"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:33.613809 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-fda380c7-e4bf-4ca9-bd20-ec6d794711fd req-09b08719-eb41-4970-ba3b-99f5de844c51 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:33.614281 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-fda380c7-e4bf-4ca9-bd20-ec6d794711fd req-09b08719-eb41-4970-ba3b-99f5de844c51 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:33.614833 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-fda380c7-e4bf-4ca9-bd20-ec6d794711fd req-09b08719-eb41-4970-ba3b-99f5de844c51 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:33.625559 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-fda380c7-e4bf-4ca9-bd20-ec6d794711fd req-09b08719-eb41-4970-ba3b-99f5de844c51 service nova] Creating event network-changed:c2647432-cbf5-4f2d-a719-a7acfd914103 for instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c on hv-cinder-84989 Aug 05 15:35:33.630661 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-fda380c7-e4bf-4ca9-bd20-ec6d794711fd req-09b08719-eb41-4970-ba3b-99f5de844c51 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030372 Aug 05 15:35:33.631255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 247/484] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:33.902667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:33.903865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:33.910847 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:33.911603 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:33.912193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:33.913138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:33.913700 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:33.914302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:34.054031 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:34.061419 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9995aba9-4fd6-49c2-83c5-dd5c8363ddf9 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1508 microversion: 2.1 time: 0.162561 Aug 05 15:35:34.062605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 238/485] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:33 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:35.085819 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:35.087579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:35.096392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:35.096893 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:35.097333 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:35.098066 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:35.098533 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:35.098957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:35.131049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:35.131528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:35.131963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:35.132438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lazy-loading 'fault' on Instance uuid 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:35:35.179358 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:35.187319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5bd6a2f7-9e8d-4477-ad09-e4cbf6f9f1e7 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 200 len: 1312 microversion: 2.1 time: 0.107670 Aug 05 15:35:35.187899 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 248/486] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:35 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:35.646107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-17b92f9e-fbba-4e8d-ab7d-c0fa48b5147d req-d3f077be-51bc-4557-8724-400fb79bfbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea1d385-2084-4d85-b55b-b3f0f3c55cb0", "name": "network-vif-deleted", "tag": "81f5f43f-6504-4380-9838-2b4d5f79d684"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:35.655523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-17b92f9e-fbba-4e8d-ab7d-c0fa48b5147d req-d3f077be-51bc-4557-8724-400fb79bfbb6 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:35.655997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-17b92f9e-fbba-4e8d-ab7d-c0fa48b5147d req-d3f077be-51bc-4557-8724-400fb79bfbb6 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:35.656443 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-17b92f9e-fbba-4e8d-ab7d-c0fa48b5147d req-d3f077be-51bc-4557-8724-400fb79bfbb6 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:35.667068 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-17b92f9e-fbba-4e8d-ab7d-c0fa48b5147d req-d3f077be-51bc-4557-8724-400fb79bfbb6 service nova] Creating event network-vif-deleted:81f5f43f-6504-4380-9838-2b4d5f79d684 for instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 on hv-cinder-84989 Aug 05 15:35:35.671966 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-17b92f9e-fbba-4e8d-ab7d-c0fa48b5147d req-d3f077be-51bc-4557-8724-400fb79bfbb6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029997 Aug 05 15:35:35.672567 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 239/487] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:36.209630 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:36.210241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:36.216624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:36.217108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:36.217546 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:36.218756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:36.219228 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:36.219646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:36.232560 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] HTTP exception thrown: Instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 could not be found. Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Request method failure captured: Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 HTTP/1.1 Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TeyvX6nv2b1b8Cp3qCnIQE1DTuxuqUOIFE8kIGCHP9No9BBdDY6X3kSB7FmWI_1Az8YDMKeMFiKHBo9co4NJQuTnEuPXyjbBeZ9e34AeBB2i8xIOo8qY2aaI8qHymt6hMOr_5O5a2vDmRtWc1JnsfKMfaY_QfZAYF-4ujPrWLQNxcw Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:35:36.234774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1cb48dbd26c747d290bf3e666e65027a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1cb48dbd26c747d290bf3e666e65027a"}]}] Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: cb055110c77543c1861dfd8c155d7582 Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 could not be found. Aug 05 15:35:36.236059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '5ea1d385-2084-4d85-b55b-b3f0f3c55cb0'} Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 could not be found. Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:35:36.236814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 could not be found. Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 could not be found. Aug 05 15:35:36.238293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:36.239814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Returning 404 to user: Instance 5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:35:36.239814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f136a7df-5efd-479d-8075-1302a15ffa94 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0" status: 404 len: 111 microversion: 2.1 time: 0.030451 Aug 05 15:35:36.239814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 249/488] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:36 2022] GET /compute/v2.1/servers/5ea1d385-2084-4d85-b55b-b3f0f3c55cb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:35:36.245336 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:36.245903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:36.252003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:36.252518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:36.252948 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:36.253623 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:36.254070 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:36.254819 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:36.278873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:35:36.572148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-66dde7bf-847e-433a-adb4-a5c0a730e9e2 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 204 len: 0 microversion: 2.1 time: 0.330808 Aug 05 15:35:36.572757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 240/489] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:35:36 2022] DELETE /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:35:36.581764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:36.582376 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:36.588462 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:36.589007 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:36.589539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:36.590252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:36.590710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:36.591134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:36.728008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:36.735862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6ab97b52-6895-4787-821c-3c3001faf5a1 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.158705 Aug 05 15:35:36.736459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 250/490] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:36 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:37.758446 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:37.759133 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:37.765771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:37.766244 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:37.766675 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:37.767350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:37.767796 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:37.768246 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:37.899997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:37.907840 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b95cceb6-a2fd-46c0-9f73-97ab17eb8d4c tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.153636 Aug 05 15:35:37.908643 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 241/491] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:37 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:38.929549 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:38.930182 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:38.936735 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:38.937794 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:38.938231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:38.938921 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:38.939381 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:38.939808 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:39.064029 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:39.071488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-530fe39a-e4f4-454c-84ad-17670a374ec6 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.145770 Aug 05 15:35:39.072050 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 251/492] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:38 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:40.091925 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:40.095251 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:40.098941 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:40.099520 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:40.099838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:40.100551 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:40.100997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:40.101415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:40.307427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:40.315591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a736cde8-9ddb-48be-a9d1-47a74bb0928f tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1522 microversion: 2.1 time: 0.227558 Aug 05 15:35:40.316181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 242/493] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:40 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:40.582934 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-df23f452-ae05-49ff-b215-b5f522ee1899 req-2dcdeb99-7f84-49d8-8557-bac364e3dccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eaf6904-d36e-48d4-9d13-cd73e2e9af47", "name": "network-vif-deleted", "tag": "9a97ceb0-7729-4faa-9ff4-2bacbdbf1823"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:40.592612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-df23f452-ae05-49ff-b215-b5f522ee1899 req-2dcdeb99-7f84-49d8-8557-bac364e3dccf service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:40.593093 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-df23f452-ae05-49ff-b215-b5f522ee1899 req-2dcdeb99-7f84-49d8-8557-bac364e3dccf service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:40.594065 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-df23f452-ae05-49ff-b215-b5f522ee1899 req-2dcdeb99-7f84-49d8-8557-bac364e3dccf service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:40.604857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-df23f452-ae05-49ff-b215-b5f522ee1899 req-2dcdeb99-7f84-49d8-8557-bac364e3dccf service nova] Creating event network-vif-deleted:9a97ceb0-7729-4faa-9ff4-2bacbdbf1823 for instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 on hv-cinder-84989 Aug 05 15:35:40.610319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-df23f452-ae05-49ff-b215-b5f522ee1899 req-2dcdeb99-7f84-49d8-8557-bac364e3dccf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031170 Aug 05 15:35:40.615122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 252/494] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:41.336436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:41.337042 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:41.343376 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:41.344399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:41.344830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:41.345513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:41.345961 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:41.346381 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:41.376730 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:41.377205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:41.377634 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:41.378076 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lazy-loading 'fault' on Instance uuid 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:35:41.422767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb055110c77543c1861dfd8c155d7582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48dbd26c747d290bf3e666e65027a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:35:41.430122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-71a200e5-2b96-4373-9a45-13e9f39683ec tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 200 len: 1311 microversion: 2.1 time: 0.097486 Aug 05 15:35:41.430678 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 243/495] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:41 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:35:42.452874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:42.453512 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] [instance: 2eaf6904-d36e-48d4-9d13-cd73e2e9af47] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:35:42.459649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:42.460163 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:42.460609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:42.461302 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:35:42.461764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:35:42.462190 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:35:42.466133 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:35:42.477272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] HTTP exception thrown: Instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 could not be found. Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Request method failure captured: Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 HTTP/1.1 Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TeyvX6nv2b1b8Cp3qCnIQE1DTuxuqUOIFE8kIGCHP9No9BBdDY6X3kSB7FmWI_1Az8YDMKeMFiKHBo9co4NJQuTnEuPXyjbBeZ9e34AeBB2i8xIOo8qY2aaI8qHymt6hMOr_5O5a2vDmRtWc1JnsfKMfaY_QfZAYF-4ujPrWLQNxcw Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:35:42.478917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1cb48dbd26c747d290bf3e666e65027a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb48dbd26c747d290bf3e666e65027a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1cb48dbd26c747d290bf3e666e65027a"}]}] Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 1cb48dbd26c747d290bf3e666e65027a Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1152901454 Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: cb055110c77543c1861dfd8c155d7582 Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1152901454-project Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 could not be found. Aug 05 15:35:42.480196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '2eaf6904-d36e-48d4-9d13-cd73e2e9af47'} Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 could not be found. Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:35:42.481051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 could not be found. Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 could not be found. Aug 05 15:35:42.482534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:35:42.483858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] Returning 404 to user: Instance 2eaf6904-d36e-48d4-9d13-cd73e2e9af47 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:35:42.483858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c2809563-9196-45cd-9dac-16c8488e2a71 tempest-ServerRescueNegativeTestJSON-1152901454 tempest-ServerRescueNegativeTestJSON-1152901454-project] 10.222.0.40 "GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47" status: 404 len: 111 microversion: 2.1 time: 0.032275 Aug 05 15:35:42.483858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 253/496] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:35:42 2022] GET /compute/v2.1/servers/2eaf6904-d36e-48d4-9d13-cd73e2e9af47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:35:47.824925 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-28791f12-f95f-4717-a0d6-054983392caf tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Action: 'create', calling method: .version_select at 0x7fcb14ed23a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1603545096", "metadata": {"Type": "work"}}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:35:48.383750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-28791f12-f95f-4717-a0d6-054983392caf tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.669263 Aug 05 15:35:48.384422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 244/497] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 5 15:35:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 671 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 15:35:48.397960 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-020acad7-fabf-4f25-9cbf-e9b344e7c9d5 tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Calling method '.version_select at 0x7fcb14efc4c0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:48.546589 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-020acad7-fabf-4f25-9cbf-e9b344e7c9d5 tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4" status: 200 len: 353 microversion: 2.1 time: 0.152850 Aug 05 15:35:48.547169 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 254/498] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:35:48 2022] GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:35:49.560988 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-de1b3269-7270-41e6-a92a-67b694db3160 tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Calling method '.version_select at 0x7fcb14e65280>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:49.660318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-de1b3269-7270-41e6-a92a-67b694db3160 tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4" status: 200 len: 354 microversion: 2.1 time: 0.103494 Aug 05 15:35:49.660879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 245/499] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:35:49 2022] GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:49.673659 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f2b66ddd-ef2c-41a9-b2e7-28892e9e58be tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Calling method '.version_select at 0x7fcb1503a9d0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:49.720233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f2b66ddd-ef2c-41a9-b2e7-28892e9e58be tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4" status: 200 len: 354 microversion: 2.1 time: 0.050350 Aug 05 15:35:49.720814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 255/500] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:35:49 2022] GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:49.739192 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7aa924ce-9362-44c3-8eb4-48b7344562be tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Calling method '.version_select at 0x7fcb14e655e0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:49.898147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7aa924ce-9362-44c3-8eb4-48b7344562be tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4" status: 202 len: 0 microversion: 2.1 time: 0.163340 Aug 05 15:35:49.898733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 246/501] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:35:49 2022] DELETE /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 15:35:49.907661 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-36456f8e-0483-4037-a18c-90a1bf4fc3c4 tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Calling method '.version_select at 0x7fcb15a75ee0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:49.953494 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-36456f8e-0483-4037-a18c-90a1bf4fc3c4 tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4" status: 200 len: 353 microversion: 2.1 time: 0.050056 Aug 05 15:35:49.954605 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 256/502] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:35:49 2022] GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:35:50.967699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-150b0f22-2b12-4a2c-8bac-422bce6461da tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Calling method '.version_select at 0x7fcb14ed2af0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:35:50.995075 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-150b0f22-2b12-4a2c-8bac-422bce6461da tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] HTTP exception thrown: Volume d2c32d67-06a5-478a-a90b-ccd749b67da4 could not be found. Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-150b0f22-2b12-4a2c-8bac-422bce6461da tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Request method failure captured: Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4 HTTP/1.1 Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TjT3y7gBr4LUZvwINaQoRtID2kIC0ZtZGnQlu9LC6D293SO93IY843udhziKAigzVAsa1xWVBhXg1VF0CJOn-0hmBVz-3avDM2wFDkkno6mu-7HVov76iEd3_R_tvVHIRiOHor5yMhDP3TN51_0ASd3gSQFypZqrST2_fCvaAV8kTo Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 2efa0c365169481995ab394c9ec0f815 Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-VolumesGetTestJSON-552824811 Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:35:50.997154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2efa0c365169481995ab394c9ec0f815", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2efa0c365169481995ab394c9ec0f815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2efa0c365169481995ab394c9ec0f815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2efa0c365169481995ab394c9ec0f815"}]}] Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-VolumesGetTestJSON-552824811 Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 2efa0c365169481995ab394c9ec0f815 Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-VolumesGetTestJSON-552824811 Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-VolumesGetTestJSON-552824811-project Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 1507bf6fa3154cab9213580b28c0b57a Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-VolumesGetTestJSON-552824811-project Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Volume d2c32d67-06a5-478a-a90b-ccd749b67da4 could not be found. Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'd2c32d67-06a5-478a-a90b-ccd749b67da4'} Aug 05 15:35:50.998576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2c32d67-06a5-478a-a90b-ccd749b67da4 could not be found. (HTTP 404) (Request-ID: req-06c31c64-e30a-4c93-9ffa-9d4849c0349f) Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:50.999394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:35:51.000501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2c32d67-06a5-478a-a90b-ccd749b67da4 could not be found. Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 15:35:51.002204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2c32d67-06a5-478a-a90b-ccd749b67da4 could not be found. Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2c32d67-06a5-478a-a90b-ccd749b67da4 could not be found. Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-150b0f22-2b12-4a2c-8bac-422bce6461da tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] Returning 404 to user: Volume d2c32d67-06a5-478a-a90b-ccd749b67da4 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-150b0f22-2b12-4a2c-8bac-422bce6461da tempest-VolumesGetTestJSON-552824811 tempest-VolumesGetTestJSON-552824811-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4" status: 404 len: 109 microversion: 2.1 time: 0.035324 Aug 05 15:35:51.003271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 247/503] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:35:50 2022] GET /compute/v2.1/os-volumes/d2c32d67-06a5-478a-a90b-ccd749b67da4 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:36:00.748435 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:00.753141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:00.753636 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:00.760320 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:00.760808 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:00.761248 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:00.761945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:00.762401 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:00.763091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:00.786403 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d461baf0-e9e8-49d0-a603-0d8228aba91d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/ips" status: 200 len: 151 microversion: 2.20 time: 0.038842 Aug 05 15:36:00.787318 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 257/504] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Aug 5 15:36:00 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:36:02.606261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:02.607034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:02.612265 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:02.612932 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:02.618850 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:02.619338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:02.619779 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:02.620508 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:02.620962 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:02.621390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:02.647464 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:36:02.905818 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-38a4b63f-7618-49f2-911f-c5089a5f421b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "DELETE /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 204 len: 0 microversion: 2.1 time: 0.300110 Aug 05 15:36:02.906642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 248/505] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:36:02 2022] DELETE /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:36:02.915075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:02.915693 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:02.922508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:02.923003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:02.923447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:02.924248 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:02.924693 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:02.925124 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:02.961167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:02.961782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:02.968312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:02.969765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:02.969765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:02.969942 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:02.970336 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:02.970758 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:02.993482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lazy-loading 'flavor' on Instance uuid 8a10dbd4-0580-46dc-821e-98476c654d5a {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:36:03.063632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:03.071538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b41abe7d-d420-4126-8fb5-9681909ac8ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1576 microversion: 2.1 time: 0.160834 Aug 05 15:36:03.072122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 258/506] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:02 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:03.397507 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f98e11d7-047d-412d-8461-fdecf25c3ea6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/action" status: 202 len: 0 microversion: 2.20 time: 0.440319 Aug 05 15:36:03.398113 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 249/507] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 5 15:36:02 2022] POST /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 05 15:36:03.406436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:03.407051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:03.413126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:03.413607 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:03.414044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:03.414733 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:03.415182 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:03.415603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:03.544483 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:03.552976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:03.554509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:03.555642 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-83469561-4d6e-4879-8d96-43a893d81f63 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.153289 Aug 05 15:36:03.556224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 259/508] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:03 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:04.094979 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:04.095705 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:04.102506 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:04.103024 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:04.103454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:04.104162 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:04.104870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:04.105292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:04.245281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:04.253386 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ae2c3c6d-5398-4abe-bb72-042ae954682e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1576 microversion: 2.1 time: 0.163920 Aug 05 15:36:04.253940 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 250/509] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:04 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:04.578676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:04.579285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:04.586410 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:04.586885 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:04.588121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:04.588121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:04.588477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:04.588900 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:04.717235 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:04.725730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:04.727221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:04.728401 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8289a601-4e78-43e3-b1cb-beb990291cc4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.153622 Aug 05 15:36:04.728952 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 260/510] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:04 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:05.275336 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:05.276177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:05.282903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:05.283506 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:05.284085 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:05.287121 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:05.287121 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:05.287121 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:05.497116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:05.506467 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-99b4cacb-68a9-457d-a731-41306e2f0f19 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1576 microversion: 2.1 time: 0.235232 Aug 05 15:36:05.507134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 251/511] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:05 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:05.751056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:05.751671 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:05.758299 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:05.759170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:05.759989 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:05.761099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:05.761564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:05.762001 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:05.963874 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-4beb2912-5938-45c4-af1d-00bc46bac4e3 req-cebba5ab-e62a-4a7a-a7a3-d5f249b53113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17362876-caa1-4703-8c1f-11c09b21eea8", "name": "network-vif-deleted", "tag": "a1c3ece6-03c8-4606-9433-311e8a05105f"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:05.978983 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-4beb2912-5938-45c4-af1d-00bc46bac4e3 req-cebba5ab-e62a-4a7a-a7a3-d5f249b53113 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:05.979781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-4beb2912-5938-45c4-af1d-00bc46bac4e3 req-cebba5ab-e62a-4a7a-a7a3-d5f249b53113 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:05.980531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-4beb2912-5938-45c4-af1d-00bc46bac4e3 req-cebba5ab-e62a-4a7a-a7a3-d5f249b53113 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:05.991912 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:05.994497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-4beb2912-5938-45c4-af1d-00bc46bac4e3 req-cebba5ab-e62a-4a7a-a7a3-d5f249b53113 service nova] Creating event network-vif-deleted:a1c3ece6-03c8-4606-9433-311e8a05105f for instance 17362876-caa1-4703-8c1f-11c09b21eea8 on hv-cinder-84989 Aug 05 15:36:06.001582 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-4beb2912-5938-45c4-af1d-00bc46bac4e3 req-cebba5ab-e62a-4a7a-a7a3-d5f249b53113 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041346 Aug 05 15:36:06.002670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 252/512] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:06.004990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:06.006836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:06.010086 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7ea0c3b9-b440-4996-bbce-86a7ce75a274 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.263035 Aug 05 15:36:06.011098 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 261/513] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:05 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:06.528937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:06.535314 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:06.536284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:06.536767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:06.537210 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:06.537993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:06.538451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:06.538882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:06.579959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:06.581109 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:06.581556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:06.582011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lazy-loading 'fault' on Instance uuid 17362876-caa1-4703-8c1f-11c09b21eea8 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:36:06.633976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:06.641952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d09a10b2-2b83-4e55-8ec0-0d2f7cc1ffe9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 200 len: 1230 microversion: 2.1 time: 0.117178 Aug 05 15:36:06.642525 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 253/514] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:06 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 1230 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:07.033841 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:07.034513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:07.041347 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:07.041999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:07.042956 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:07.043665 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:07.044224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:07.044703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:07.178334 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:07.186374 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:07.188046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:07.189225 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-282bac0a-48a8-42b8-9a76-039097884673 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.159293 Aug 05 15:36:07.190561 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 262/515] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:07 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:07.666142 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:07.666754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:07.673267 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:07.673746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:07.674182 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:07.674870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:07.675323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:07.675748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:07.688869 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] HTTP exception thrown: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Request method failure captured: Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 HTTP/1.1 Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TggOUGASJ2xEeUWjiMlZQ8nvKC4dC76mMYmGiEGTuyEluIIWhFQ2bBA_wOrHpPW89KmGTXHKIDjw0oUcRfXNmMKZV_WnvYjIhO8o8Cf-OTNLHz0FjXR4E7ZzuaVbIaHmHQ5INfr5ubNYIOWIHOjxMRUnihxnbqM4bbUzX0RllJWv74 Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:36:07.690498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99b26247f85d45c0a7c1e763758f2e69", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99b26247f85d45c0a7c1e763758f2e69"}]}] Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 1782b4e84c9f484297e17c248738105c Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:36:07.693606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '17362876-caa1-4703-8c1f-11c09b21eea8'} Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:36:07.694560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:36:07.696020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:07.697345 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Returning 404 to user: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:36:07.697345 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-acea6638-a4c1-4188-ac34-c3fefabc1146 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 404 len: 111 microversion: 2.1 time: 0.029834 Aug 05 15:36:07.697345 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 254/516] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:07 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:36:07.787476 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1319955079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1091585729", "security_groups": [{"name": "tempest-secgroup-smoke-1650709576"}], "block_device_mapping_v2": [{"uuid": "191e9262-6350-47a9-ae6e-7b94556473f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b73dcac-fd0b-490d-b366-7eddfd909984"}]}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:07.897371 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] validate_networks() for [('9b73dcac-fd0b-490d-b366-7eddfd909984', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:36:08.213338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:08.214044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:08.220380 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:08.220856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:08.221281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:08.221964 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:08.222412 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:08.222830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:08.430034 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:36:08.431094 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:36:08.431473 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:36:08.431924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:36:08.432395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:36:08.434146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:08.442050 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:08.442537 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:08.442979 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:08.443122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:08.444164 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:08.444628 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:08.444774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:08.445059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:08.446035 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-39064225-57f6-450c-a1b7-4263508b1963 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.236595 Aug 05 15:36:08.456415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 255/517] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:08 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:08.462080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Getting quotas for project 99b26247f85d45c0a7c1e763758f2e69. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:36:08.466100 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Getting quotas for user 1782b4e84c9f484297e17c248738105c and project 99b26247f85d45c0a7c1e763758f2e69. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:36:08.525910 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:36:08.527981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='191e9262-6350-47a9-ae6e-7b94556473f6',volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:36:08.947669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5caf5d5e-8b5c-4e24-bddd-657ff737eb77 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.164605 Aug 05 15:36:08.948388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 263/518] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:36:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:36:08.960164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5804962a-7bd7-4b94-8dcd-9b79704e4b97 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:08.960933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5804962a-7bd7-4b94-8dcd-9b79704e4b97 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:09.022691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5804962a-7bd7-4b94-8dcd-9b79704e4b97 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:09.038975 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5804962a-7bd7-4b94-8dcd-9b79704e4b97 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1095 microversion: 2.1 time: 0.074435 Aug 05 15:36:09.038975 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 256/519] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:08 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:09.469879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:09.470485 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:09.477230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:09.477704 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:09.478136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:09.478825 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:09.479275 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:09.479692 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:09.617943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:09.625930 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:09.627475 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:09.628770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e9e5268e-cc81-49fc-a0d3-815c89ad8a23 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.163286 Aug 05 15:36:09.629351 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 264/520] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:09 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:09.847360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:09.847851 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:09.854368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:09.854790 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:09.855220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:09.855898 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:09.856371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:09.856805 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:09.879951 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-21068731-e5f0-424f-b693-80857cc0d934 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/ips" status: 200 len: 147 microversion: 2.1 time: 0.200472 Aug 05 15:36:09.880821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 257/521] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:36:09 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/ips => generated 147 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:10.051237 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:10.056990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:10.057963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:10.058450 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:10.058887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:10.059586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:10.060042 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:10.060498 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:10.121271 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:10.129328 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b06dc0d4-cc93-44d3-890a-13979697b113 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1145 microversion: 2.1 time: 0.082439 Aug 05 15:36:10.129914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 265/522] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:10 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:10.894976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:10.895534 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:10.902304 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:10.902790 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:10.903230 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:10.903925 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:10.904499 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:10.904840 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:11.095208 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:11.103404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:11.107511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:11.108725 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3ab099cc-154b-47ee-b4de-e5b565ca959c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.460498 Aug 05 15:36:11.109283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 258/523] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:10 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:11.152896 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:11.152896 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:11.159296 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:11.159783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:11.160246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:11.161054 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:11.161698 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:11.162119 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:11.249961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:11.259393 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4885caa8-b067-4259-82a2-d6beaecaba22 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1201 microversion: 2.1 time: 0.112411 Aug 05 15:36:11.260295 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 266/524] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:11 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1201 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:11.466701 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7b60551-e965-41d9-9508-8bcee962eb1c"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:11.469709 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:11.477220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:11.477696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:11.478220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:11.478908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:11.479350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:11.479769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:11.962377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:36:11.963035 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Fri Aug 5 15:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments (ip 10.222.0.40) !!! Aug 05 15:36:12.132284 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:12.137439 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:12.139253 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:12.139747 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:12.140222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:12.140958 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:12.141417 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:12.141844 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:12.255367 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3cabc508-da80-4ebf-be94-6449e0fff410 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792348 Aug 05 15:36:12.256518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 259/525] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:36:11 2022] POST /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments => generated 194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:12.308302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:12.310191 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:12.338228 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:12.339025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:12.341999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:12.343177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:12.345612 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:12.346440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:12.439713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:12.465370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:12.472372 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:12.475624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d7d93451-3e3d-457e-8b35-3506544a87f7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.347384 Aug 05 15:36:12.477492 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 267/526] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:12 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:12.626438 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:12.634278 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-acbd17be-009d-4118-a395-43ec90e7b343 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1279 microversion: 2.1 time: 0.342285 Aug 05 15:36:12.634945 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 260/527] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:12 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1279 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:13.096216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-c89daac3-ce72-482a-92fd-fdff1fe88f9d req-1fe25d84-37f3-4bec-96ea-0ec3371deead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06b5eb5-e324-4e7d-a084-27a8344c861b", "tag": "8f81a0ab-db08-458a-a907-344e54cc9456"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:13.099394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c89daac3-ce72-482a-92fd-fdff1fe88f9d req-1fe25d84-37f3-4bec-96ea-0ec3371deead service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:13.099871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c89daac3-ce72-482a-92fd-fdff1fe88f9d req-1fe25d84-37f3-4bec-96ea-0ec3371deead service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:13.100323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c89daac3-ce72-482a-92fd-fdff1fe88f9d req-1fe25d84-37f3-4bec-96ea-0ec3371deead service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:13.110972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-c89daac3-ce72-482a-92fd-fdff1fe88f9d req-1fe25d84-37f3-4bec-96ea-0ec3371deead service nova] Creating event network-changed:8f81a0ab-db08-458a-a907-344e54cc9456 for instance c06b5eb5-e324-4e7d-a084-27a8344c861b on hv-cinder-84989 Aug 05 15:36:13.116149 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-c89daac3-ce72-482a-92fd-fdff1fe88f9d req-1fe25d84-37f3-4bec-96ea-0ec3371deead service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030723 Aug 05 15:36:13.116871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 268/528] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:36:13.501732 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:13.502515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:13.509759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:13.510253 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:13.510687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:13.511394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:13.511843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:13.512297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:13.655613 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:13.656284 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:13.662676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:13.663168 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:13.663609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:13.664435 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:13.664893 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:13.665320 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:14.152288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:14.160424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-75d017a7-c26c-4dff-b5e5-55992627c2b3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.509143 Aug 05 15:36:14.161058 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 269/529] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:13 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:14.175704 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:14.184236 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:14.195020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:14.195020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:14.195020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ff37023b-4547-4f72-8bd1-9201f9a65cb9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.696969 Aug 05 15:36:14.195534 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 261/530] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:13 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:15.186626 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:15.187240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:15.194211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:15.194705 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:15.195282 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:15.195994 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:15.196478 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:15.196907 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:15.218147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:15.218791 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:15.226858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:15.227348 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:15.227778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:15.228745 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:15.229176 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:15.229947 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:15.408293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:15.415841 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ccb646fb-257a-4328-9bb4-7386f921f73d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.233040 Aug 05 15:36:15.416442 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 270/531] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:15 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:15.419449 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:15.428909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:15.430496 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:15.431683 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7d19d4f3-9e8f-42b9-950c-445cdb94c868 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.218166 Aug 05 15:36:15.432264 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 262/532] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:15 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:16.436795 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:16.437336 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:16.443610 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:16.444106 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:16.444542 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:16.445225 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:16.445674 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:16.446091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:16.454854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:16.456598 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:16.461953 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:16.462436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:16.462871 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:16.463644 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:16.464017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:16.464464 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:16.639725 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:16.647632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-cb252efb-ec7d-49e5-81c8-c326ff87e709 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.214799 Aug 05 15:36:16.648232 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 271/533] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:16 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:16.654942 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:16.663591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:16.665107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:16.666261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a2cdc852-4cb7-43a9-ba52-b0ab9173da0d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.215429 Aug 05 15:36:16.666815 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 263/534] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:16 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:16.963509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1456959912", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "networks": [{"uuid": "aae8b9f3-a089-477d-a5f7-c4cd568027cc"}]}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:17.014992 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] validate_networks() for [('aae8b9f3-a089-477d-a5f7-c4cd568027cc', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:36:17.353669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:36:17.354097 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:36:17.354578 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:36:17.354990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:36:17.355407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:36:17.364570 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:17.365080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:17.365544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:17.366284 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:17.366742 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:17.367164 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:17.388567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Getting quotas for project 07cd370ebabf4f048e72f7b1fbadcb08. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:36:17.388567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Getting quotas for user ff040e1f99bf46d48446e2e9c0deb9cc and project 07cd370ebabf4f048e72f7b1fbadcb08. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:36:17.399779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:36:17.402086 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:36:17.497294 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-27275a38-dd2a-4d02-9f05-c18f07e5620e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537515 Aug 05 15:36:17.498231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 272/535] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:36:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:36:17.509160 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-fbc7ddc4-48ff-4ef1-88e8-f7ca2c6bf8f1 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:17.509779 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-fbc7ddc4-48ff-4ef1-88e8-f7ca2c6bf8f1 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:17.563466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fbc7ddc4-48ff-4ef1-88e8-f7ca2c6bf8f1 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:17.570677 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-fbc7ddc4-48ff-4ef1-88e8-f7ca2c6bf8f1 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1214 microversion: 2.1 time: 0.065351 Aug 05 15:36:17.571458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 264/536] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:17 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:17.668924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:17.670022 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:17.677338 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:17.677959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:17.678462 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:17.679260 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:17.679906 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:17.680432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:17.690099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:17.691308 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:17.697949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:17.698458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:17.698899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:17.699600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:17.700054 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:17.700502 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:17.881377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:17.890089 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-79717333-cf45-48f8-b49d-dadf9f78910e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.224881 Aug 05 15:36:17.890742 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 273/537] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:17 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:17.894478 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:17.903196 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:17.904906 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:17.906091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ba48f82f-2954-4b55-b06f-f42bafebb328 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.220500 Aug 05 15:36:17.906656 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 265/538] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:17 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:18.591004 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:18.591635 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:18.598134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:18.598647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:18.599075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:18.599761 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:18.600249 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:18.600669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:18.662225 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:18.670944 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-82fdd32f-fe0c-45fe-8064-c02d4ec96a1a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1218 microversion: 2.1 time: 0.083922 Aug 05 15:36:18.671528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 274/539] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:18 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:18.911367 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:18.911923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:18.918364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:18.921680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:18.921680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:18.921680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:18.921680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:18.922040 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:18.930581 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:18.931971 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:18.938648 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:18.939211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:18.939718 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:18.941155 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:18.941616 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:18.942041 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:19.125256 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:19.134940 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f152173b-9d2f-4282-8435-2432f9d262ea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.227522 Aug 05 15:36:19.135593 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 266/540] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:18 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:19.149063 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:19.149063 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:19.150779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:19.152420 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:19.153649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-aab56507-4f08-429d-9b17-12ff32f59466 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.227115 Aug 05 15:36:19.154314 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 275/541] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:18 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:19.690851 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:19.691390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:19.697414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:19.697859 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:19.698296 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:19.698984 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:19.699436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:19.699867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:19.765336 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:19.773570 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ed8f0fb0-17ad-4861-b222-25ffb307d79e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1266 microversion: 2.1 time: 0.086732 Aug 05 15:36:19.774219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 267/542] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:19 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:19.880920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:19.883576 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:19.891993 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:19.892511 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:19.893031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:19.894226 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:19.894681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:19.895102 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:19.924990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0354c7be-9df9-4236-93f3-14ff422fa9d1 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048474 Aug 05 15:36:19.925534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 276/543] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:36:19 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:19.936469 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:19.936973 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:19.943878 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:19.944335 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:19.944768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:19.945458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:19.946077 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:19.946750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:19.976126 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ec521a1a-ab08-4538-8d4a-b2743597e7a7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e7b60551-e965-41d9-9508-8bcee962eb1c" status: 200 len: 194 microversion: 2.1 time: 0.043821 Aug 05 15:36:19.979509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 268/544] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 5 15:36:19 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e7b60551-e965-41d9-9508-8bcee962eb1c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:20.156745 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:20.157369 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:20.163337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:20.163818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:20.164279 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:20.164962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:20.165414 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:20.165837 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:20.179312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:20.179908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:20.185925 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:20.186317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:20.186758 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:20.187459 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:20.187913 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:20.188555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:20.367915 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:20.375502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4eb09810-c502-4753-a334-619647a78bfc tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.223004 Aug 05 15:36:20.375632 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:20.376087 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 277/545] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:20 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:20.384385 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:20.385867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:20.387009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3bb896c5-a612-4764-a8b3-869390831036 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1743 microversion: 2.20 time: 0.211590 Aug 05 15:36:20.387548 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 269/546] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:20 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:20.796164 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:20.797096 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:20.804023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:20.804544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:20.805005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:20.805827 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:20.806291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:20.806713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:20.904283 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:20.912166 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-87a2ebe9-ba8b-43e7-9e04-61f0172e7fe7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1284 microversion: 2.1 time: 0.121205 Aug 05 15:36:20.912736 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 278/547] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:20 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:21.396781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:21.397387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:21.403846 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:21.404358 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:21.404790 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:21.405478 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:21.406113 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:21.406520 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:21.411113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:21.411731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:21.417921 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:21.418412 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:21.418907 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:21.419607 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:21.420059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:21.420532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:21.703771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:21.711269 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-83506c93-e75c-4d6a-97e6-b34daeedd073 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.318887 Aug 05 15:36:21.711834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 270/548] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:21 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:21.716549 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e040ea4f-21e6-47c1-9165-13434ef45586"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:21.719143 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:21.725629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:21.726113 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:21.726546 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:21.727239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:21.727692 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:21.728142 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:21.731784 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:21.740285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:21.741799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:21.742967 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-011102da-a2cc-490a-8f08-f909aa3d260d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1743 microversion: 2.20 time: 0.336413 Aug 05 15:36:21.743517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 279/549] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:21 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1743 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:21.934262 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:21.937142 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:21.942348 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:21.942916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:21.943431 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:21.944303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:21.944845 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:21.945340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:22.155061 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:22.163254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b604bf85-cc8e-4cc0-9a37-bd41f1fbb72c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1314 microversion: 2.1 time: 0.233061 Aug 05 15:36:22.163845 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 280/550] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:21 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:22.477666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-5a01ccf4-b597-431c-9932-9c99c8ba43a1 req-f5ce6998-6547-4de8-8779-c550f0dd4330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef464ba-20cc-4ffc-b424-083439bfa6d8", "tag": "dfd7bc61-f7c4-4ac3-af7d-0b67959b3bb4"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:22.487738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-5a01ccf4-b597-431c-9932-9c99c8ba43a1 req-f5ce6998-6547-4de8-8779-c550f0dd4330 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:22.488477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-5a01ccf4-b597-431c-9932-9c99c8ba43a1 req-f5ce6998-6547-4de8-8779-c550f0dd4330 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:22.489116 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-5a01ccf4-b597-431c-9932-9c99c8ba43a1 req-f5ce6998-6547-4de8-8779-c550f0dd4330 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:22.501135 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-5a01ccf4-b597-431c-9932-9c99c8ba43a1 req-f5ce6998-6547-4de8-8779-c550f0dd4330 service nova] Creating event network-changed:dfd7bc61-f7c4-4ac3-af7d-0b67959b3bb4 for instance fef464ba-20cc-4ffc-b424-083439bfa6d8 on hv-cinder-84989 Aug 05 15:36:22.507015 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-5a01ccf4-b597-431c-9932-9c99c8ba43a1 req-f5ce6998-6547-4de8-8779-c550f0dd4330 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180810 Aug 05 15:36:22.507612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 281/551] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:36:22.540328 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0f27a5be-3ea8-463c-b54a-6fa8c01b665e tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "POST /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827221 Aug 05 15:36:22.541220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 271/552] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:36:21 2022] POST /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:22.750708 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:22.750708 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:22.750708 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:22.750708 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:22.751453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:22.751453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:22.751453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:22.751453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:22.766882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:22.767656 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:22.773923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:22.774684 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:22.775331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:22.776232 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:22.776832 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:22.777394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:22.988449 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:22.998411 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6156a3fb-5f40-47d8-8d8f-2fd1336db618 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.268942 Aug 05 15:36:22.998926 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 282/553] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:22 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:23.006818 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:23.016140 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:23.017774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:23.018777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-02732277-8371-4fa7-896a-4e680da7c6d5 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.257154 Aug 05 15:36:23.019329 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 272/554] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:22 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:23.185424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:23.186109 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:23.192541 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:23.193027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:23.193470 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:23.194203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:23.195560 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:23.196548 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:23.355628 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:23.364051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9c360045-c826-4a7d-9396-46d50d2f618c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1314 microversion: 2.1 time: 0.182957 Aug 05 15:36:23.364641 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 283/555] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:23 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:24.019726 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:24.020486 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:24.038380 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:24.040930 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:24.041425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:24.042218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:24.042698 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:24.043164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:24.052871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:24.053486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:24.074243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:24.075013 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:24.075624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:24.076605 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:24.077240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:24.077840 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:24.413221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:24.425679 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:24.427753 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:24.429218 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c019d555-8241-44ac-9afa-70124f1ec4f0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.389420 Aug 05 15:36:24.431216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 284/556] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:24 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:24.437113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:24.438046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:24.446120 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:24.446963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:24.447646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:24.448751 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:24.449601 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:24.450244 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:24.570594 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:24.584663 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-198abbb6-fcda-408f-8b8e-706d45f88b7a tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.566890 Aug 05 15:36:24.585408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 273/557] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:24 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:24.603390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-8f550ecc-794d-4ae8-bc26-06d9f859c045 req-771211fe-3fb0-4d9f-8aad-46e15752d05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a10dbd4-0580-46dc-821e-98476c654d5a", "name": "network-vif-plugged", "status": "completed", "tag": "b7a39fee-4688-4052-adea-986dac23d796"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:24.625361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-8f550ecc-794d-4ae8-bc26-06d9f859c045 req-771211fe-3fb0-4d9f-8aad-46e15752d05a service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:24.627398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-8f550ecc-794d-4ae8-bc26-06d9f859c045 req-771211fe-3fb0-4d9f-8aad-46e15752d05a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:24.627398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-8f550ecc-794d-4ae8-bc26-06d9f859c045 req-771211fe-3fb0-4d9f-8aad-46e15752d05a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:24.642631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-8f550ecc-794d-4ae8-bc26-06d9f859c045 req-771211fe-3fb0-4d9f-8aad-46e15752d05a service nova] Creating event network-vif-plugged:b7a39fee-4688-4052-adea-986dac23d796 for instance 8a10dbd4-0580-46dc-821e-98476c654d5a on hv-cinder-84989 Aug 05 15:36:24.650048 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-8f550ecc-794d-4ae8-bc26-06d9f859c045 req-771211fe-3fb0-4d9f-8aad-46e15752d05a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051553 Aug 05 15:36:24.651792 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 274/558] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:24.754017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:24.764005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-aadc1c67-cf81-4448-97eb-f3ea07261e08 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1314 microversion: 2.1 time: 0.331368 Aug 05 15:36:24.778024 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 285/559] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:24 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:25.459970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:25.460710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:25.467949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:25.468722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:25.469480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:25.470406 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:25.471053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:25.471477 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:25.607090 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:25.608487 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:25.616013 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:25.616868 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:25.618012 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:25.618931 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:25.619601 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:25.620171 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:25.624960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:25.637375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:25.639009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:25.640479 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e2f9f793-b1b8-404a-bd1b-9a2470c49f37 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.185675 Aug 05 15:36:25.641189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 275/560] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:25 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:25.767557 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:25.783136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f7906b9f-13ba-4358-857b-44b33a85a58c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.180109 Aug 05 15:36:25.784024 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 286/561] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:25 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:25.793995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:25.794924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:25.804804 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:25.805661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:25.806058 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:25.806901 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:25.807434 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:25.807988 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:25.967352 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:25.977034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b335a95c-ee5e-415b-a12e-d38467a0bbc7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1314 microversion: 2.1 time: 0.195422 Aug 05 15:36:25.988096 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 276/562] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:25 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:26.669543 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:26.670452 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:26.672285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-8923b625-2a26-4d99-aca9-5c3860ee3a97 req-a02f4f30-6cb1-4f39-9a74-81777c6f5ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06b5eb5-e324-4e7d-a084-27a8344c861b", "name": "network-vif-plugged", "status": "completed", "tag": "8f81a0ab-db08-458a-a907-344e54cc9456"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:26.679430 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:26.679923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:26.680398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:26.682556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:26.682556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:26.682556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:26.685305 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-8923b625-2a26-4d99-aca9-5c3860ee3a97 req-a02f4f30-6cb1-4f39-9a74-81777c6f5ed7 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:26.685798 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-8923b625-2a26-4d99-aca9-5c3860ee3a97 req-a02f4f30-6cb1-4f39-9a74-81777c6f5ed7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:26.686229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-8923b625-2a26-4d99-aca9-5c3860ee3a97 req-a02f4f30-6cb1-4f39-9a74-81777c6f5ed7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:26.710821 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-8923b625-2a26-4d99-aca9-5c3860ee3a97 req-a02f4f30-6cb1-4f39-9a74-81777c6f5ed7 service nova] Creating event network-vif-plugged:8f81a0ab-db08-458a-a907-344e54cc9456 for instance c06b5eb5-e324-4e7d-a084-27a8344c861b on hv-cinder-84989 Aug 05 15:36:26.720691 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-8923b625-2a26-4d99-aca9-5c3860ee3a97 req-a02f4f30-6cb1-4f39-9a74-81777c6f5ed7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056712 Aug 05 15:36:26.721562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 287/563] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:26.806007 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:26.806999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:26.820452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:26.821141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:26.821744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:26.822610 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:26.831611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:26.832123 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:26.973048 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:26.983003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:26.986517 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:26.989612 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5ca393b1-3ad0-4f76-ade2-eecb067d8ec0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.323902 Aug 05 15:36:26.990666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 277/564] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:26 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:27.006932 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:27.014767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:27.025785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:27.026484 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:27.027217 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:27.028750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:27.030247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:27.030839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:27.098167 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:27.105723 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7781ccf2-f99b-4ceb-bd4e-a3b225416a9b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.305364 Aug 05 15:36:27.106873 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 288/565] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:26 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:27.262999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:27.267138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:27.273062 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-da7d640d-78c3-4805-8c91-92d6af26c220 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1314 microversion: 2.1 time: 0.273309 Aug 05 15:36:27.287075 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 278/566] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:26 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:28.023836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:28.025080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:28.030335 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=4 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:28.031046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=12 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:28.033433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:28.033928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:28.034603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:28.035502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:28.035963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:28.036676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:28.126369 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:28.127601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:28.130404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=4 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:28.141767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:28.142271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:28.142717 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:28.143438 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:28.143896 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:28.144397 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:28.211127 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:28.226046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:28.229122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:28.234622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e7c7d24d-ada9-40fd-99a3-332d3dfcaf10 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.214823 Aug 05 15:36:28.236010 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 289/567] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:28 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:28.296829 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:28.298636 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:28.306570 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:28.308271 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:28.309300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:28.311267 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:28.312411 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:28.313080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:28.431318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:28.457068 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-38e72b3a-d7b6-4b10-a59f-d77fa1e63e55 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1267 microversion: 2.1 time: 0.330848 Aug 05 15:36:28.470785 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 279/568] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:28 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1267 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:28.528040 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:28.537190 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7e8a664d-4537-4d98-b76c-09afbc0b403e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1314 microversion: 2.1 time: 0.246418 Aug 05 15:36:28.540392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 290/569] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:28 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:28.773754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-ad0063af-41a3-4d9d-b626-a725f17dfb6b req-f777e557-eb27-46cc-b22c-72c9162459d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef464ba-20cc-4ffc-b424-083439bfa6d8", "name": "network-vif-plugged", "status": "completed", "tag": "dfd7bc61-f7c4-4ac3-af7d-0b67959b3bb4"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:28.786808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-ad0063af-41a3-4d9d-b626-a725f17dfb6b req-f777e557-eb27-46cc-b22c-72c9162459d2 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:28.787374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-ad0063af-41a3-4d9d-b626-a725f17dfb6b req-f777e557-eb27-46cc-b22c-72c9162459d2 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:28.787733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-ad0063af-41a3-4d9d-b626-a725f17dfb6b req-f777e557-eb27-46cc-b22c-72c9162459d2 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:28.799965 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-ad0063af-41a3-4d9d-b626-a725f17dfb6b req-f777e557-eb27-46cc-b22c-72c9162459d2 service nova] Creating event network-vif-plugged:dfd7bc61-f7c4-4ac3-af7d-0b67959b3bb4 for instance fef464ba-20cc-4ffc-b424-083439bfa6d8 on hv-cinder-84989 Aug 05 15:36:28.808372 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-ad0063af-41a3-4d9d-b626-a725f17dfb6b req-f777e557-eb27-46cc-b22c-72c9162459d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038936 Aug 05 15:36:28.808999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 280/570] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:29.377738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:29.377738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:29.377738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:29.377738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:29.379707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:29.379707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:29.379707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:29.379707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:29.380043 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:29.415677 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:29.423531 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:29.425057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:29.426837 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c287380c-71fd-45a3-9288-f404ecf6bcc6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.170787 Aug 05 15:36:29.427394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 291/571] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:29 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:29.492783 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:29.493487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:29.499622 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:29.500134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:29.500580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:29.501271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:29.501727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:29.502159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:29.573523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:29.574145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:29.580852 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:29.581545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:29.582312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:29.583920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:29.584440 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:29.584853 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:29.670765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:29.678999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-985151ec-fa4e-413a-afe9-511d15d17e0d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1454 microversion: 2.1 time: 0.191440 Aug 05 15:36:29.679668 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 281/572] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:29 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:29.700197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:29.700818 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:29.708167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:29.708650 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:29.709090 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:29.710992 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:29.710992 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:29.710992 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:29.738911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:29.747274 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-723058f9-2328-422d-9535-9179d4bcbd8f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1314 microversion: 2.1 time: 0.177710 Aug 05 15:36:29.748048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 292/573] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:29 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:29.862282 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:29.873439 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-590d64e3-1cbe-4d0f-a60e-9f2b00695bea tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1454 microversion: 2.1 time: 0.176946 Aug 05 15:36:29.884282 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 282/574] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:29 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:30.452394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:30.453783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:30.470591 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:30.471189 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:30.471712 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:30.472553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:30.476777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:30.477254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:30.667965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:30.671672 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:30.677250 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:30.678996 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:30.680417 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a4857753-5f0b-4414-87ad-4f1e026e71f3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.233632 Aug 05 15:36:30.692344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 293/575] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:30 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:30.770153 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:30.770887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:30.780162 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:30.781244 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:30.781894 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:30.782897 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:30.783854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:30.785055 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.066086 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:31.081614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-53285b55-a25f-45d1-b2f3-f7e77b52a8fd tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1314 microversion: 2.1 time: 0.316400 Aug 05 15:36:31.085510 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 283/576] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:30 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:31.323619 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:31.326416 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:31.334477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:31.334967 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:31.335405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.336143 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:31.336598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:31.337051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.376025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1be8f86b-ea36-4a78-8bc1-e4ff6dd743e3 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057056 Aug 05 15:36:31.376804 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 294/577] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:36:31 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:31.527354 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:31.527881 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:31.535819 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:31.539223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:31.539223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.539223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:31.539223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:31.539548 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.588033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e1ec8a2b-c422-4dce-a93d-6d75cd88febe tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e7b60551-e965-41d9-9508-8bcee962eb1c" status: 200 len: 194 microversion: 2.1 time: 0.062097 Aug 05 15:36:31.588033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 284/578] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 5 15:36:31 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e7b60551-e965-41d9-9508-8bcee962eb1c => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:31.593202 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:31.594392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:31.602351 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:31.603459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:31.604423 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.605630 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:31.606503 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:31.607244 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.706416 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:31.707558 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:31.708371 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lazy-loading 'services' on Instance uuid adba90d0-6910-4741-a3c7-a7fa5ffbda9c {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:36:31.723346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:31.724500 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:31.724943 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.725669 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:31.728550 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:31.728999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:31.962080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b988f1e5-fa6c-4891-b6e1-6a0066543cde tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e7b60551-e965-41d9-9508-8bcee962eb1c" status: 202 len: 0 microversion: 2.1 time: 0.372487 Aug 05 15:36:31.963324 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 295/579] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:36:31 2022] DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e7b60551-e965-41d9-9508-8bcee962eb1c => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:36:32.108912 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:32.109564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:32.126007 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:32.130484 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:32.135586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:32.136260 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:32.138693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:32.139643 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:32.140295 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:32.141234 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:32.146676 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:32.148116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1a7ec763-36e5-43a8-9c0c-6f1fe1fdddf9 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.446404 Aug 05 15:36:32.150989 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 285/580] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:31 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:32.399382 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:32.407771 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a4408490-48aa-4d32-b33a-54e1dc3b8316 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1498 microversion: 2.1 time: 0.303169 Aug 05 15:36:32.408675 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 296/581] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:32 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1498 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:33.175817 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:33.176474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:33.179368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:33.184458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:33.184949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:33.185388 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:33.189458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:33.189458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:33.189458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:33.345713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-d4884d37-ae1a-4fa0-9851-4d2971fc8166 req-4096bb6a-aaa0-42f5-9345-ec0b082135a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06b5eb5-e324-4e7d-a084-27a8344c861b", "tag": "8f81a0ab-db08-458a-a907-344e54cc9456"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:33.386202 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-d4884d37-ae1a-4fa0-9851-4d2971fc8166 req-4096bb6a-aaa0-42f5-9345-ec0b082135a4 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:33.389445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-d4884d37-ae1a-4fa0-9851-4d2971fc8166 req-4096bb6a-aaa0-42f5-9345-ec0b082135a4 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:33.390064 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-d4884d37-ae1a-4fa0-9851-4d2971fc8166 req-4096bb6a-aaa0-42f5-9345-ec0b082135a4 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:33.429935 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:33.439218 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-d4884d37-ae1a-4fa0-9851-4d2971fc8166 req-4096bb6a-aaa0-42f5-9345-ec0b082135a4 service nova] Creating event network-changed:8f81a0ab-db08-458a-a907-344e54cc9456 for instance c06b5eb5-e324-4e7d-a084-27a8344c861b on hv-cinder-84989 Aug 05 15:36:33.447219 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-d4884d37-ae1a-4fa0-9851-4d2971fc8166 req-4096bb6a-aaa0-42f5-9345-ec0b082135a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118608 Aug 05 15:36:33.452056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 297/582] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:36:33.452579 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:33.454409 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:33.455606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-10145201-e76d-4b9f-9b0f-e892e6fd5b92 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.283734 Aug 05 15:36:33.456185 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 286/583] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:33 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:33.964822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:33.965886 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:33.973049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:33.974298 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:33.974931 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:33.975862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:33.976496 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:33.976937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.004972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Going to try to terminate instance {{(pid=118723) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:36:34.184446 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:34.185455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:34.192607 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:34.193096 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:34.193540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.197240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:34.197240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:34.197240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.232090 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e8a804fc-7e27-4a2b-a38d-022ca07c7001 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e040ea4f-21e6-47c1-9165-13434ef45586" status: 200 len: 194 microversion: 2.1 time: 0.052722 Aug 05 15:36:34.233024 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 287/584] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 5 15:36:34 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e040ea4f-21e6-47c1-9165-13434ef45586 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:34.242969 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:34.243458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:34.250395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:34.266456 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:34.266456 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.266456 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:34.266456 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:34.266830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.359849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-224d9284-c3e3-47bf-bb3f-7029c13f52c7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 204 len: 0 microversion: 2.1 time: 0.398744 Aug 05 15:36:34.363658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 298/585] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:36:33 2022] DELETE /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:36:34.369428 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:34.370129 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:34.376487 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:34.376965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:34.377404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.378088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:34.378537 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:34.378957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.389307 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lazy-loading 'services' on Instance uuid adba90d0-6910-4741-a3c7-a7fa5ffbda9c {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:36:34.533516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:34.541129 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-650ced44-cec9-4030-9e2f-a6e7842de5ed tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1504 microversion: 2.1 time: 0.175921 Aug 05 15:36:34.541686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 299/586] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:34 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:34.546245 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:34.546839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:34.552903 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:34.553385 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:34.555823 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.555823 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:34.555823 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:34.555823 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:34.684222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:34.692873 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:34.694407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:34.695642 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f74b1890-dab4-4ff2-b0d0-8378b3d05065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.152975 Aug 05 15:36:34.696783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 300/587] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:34 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:34.713292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b779cc7b-54fc-441e-ae12-3c136fbfbd50 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e040ea4f-21e6-47c1-9165-13434ef45586" status: 202 len: 0 microversion: 2.1 time: 0.474048 Aug 05 15:36:34.713895 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 288/588] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:36:34 2022] DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments/e040ea4f-21e6-47c1-9165-13434ef45586 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 15:36:35.562170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:35.562777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:35.570026 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:35.570510 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:35.570947 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:35.571640 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:35.572117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:35.572543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:35.702213 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:35.709666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e428ad40-b008-494d-804a-af680fb1251c tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1504 microversion: 2.1 time: 0.151387 Aug 05 15:36:35.710242 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 301/589] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:35 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:35.719760 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:35.721029 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:35.727658 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:35.728186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:35.728624 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:35.729318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:35.729772 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:35.730207 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:35.907141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:35.915516 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:35.917049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:35.918193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-afcec891-75ae-479c-bcb0-61d0fca30ed7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1738 microversion: 2.20 time: 0.203163 Aug 05 15:36:35.918745 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 289/590] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:35 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:36.698236 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-d4740621-419d-4b0a-97bc-87655b15362c req-33a43c37-ea53-4f12-8277-b00a3a5ab1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef464ba-20cc-4ffc-b424-083439bfa6d8", "name": "network-vif-deleted", "tag": "dfd7bc61-f7c4-4ac3-af7d-0b67959b3bb4"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:36.707260 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-d4740621-419d-4b0a-97bc-87655b15362c req-33a43c37-ea53-4f12-8277-b00a3a5ab1d3 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:36.707756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-d4740621-419d-4b0a-97bc-87655b15362c req-33a43c37-ea53-4f12-8277-b00a3a5ab1d3 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:36.708212 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-d4740621-419d-4b0a-97bc-87655b15362c req-33a43c37-ea53-4f12-8277-b00a3a5ab1d3 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:36.719289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-d4740621-419d-4b0a-97bc-87655b15362c req-33a43c37-ea53-4f12-8277-b00a3a5ab1d3 service nova] Creating event network-vif-deleted:dfd7bc61-f7c4-4ac3-af7d-0b67959b3bb4 for instance fef464ba-20cc-4ffc-b424-083439bfa6d8 on hv-cinder-84989 Aug 05 15:36:36.724418 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-d4740621-419d-4b0a-97bc-87655b15362c req-33a43c37-ea53-4f12-8277-b00a3a5ab1d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030627 Aug 05 15:36:36.731061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:36.731683 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:36.738077 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:36.738574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:36.739046 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:36.739759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:36.740148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 302/591] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:36:36.740323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:36.741551 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:36.810043 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:36.818281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7d77c99a-1359-4148-92bf-9a3ed7cada98 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1462 microversion: 2.1 time: 0.091318 Aug 05 15:36:36.818856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 290/592] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:36 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:36.943192 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:36.943954 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:36.947721 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:36.949999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:36.950533 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:36.951020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:36.951457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:36.952324 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:36.952774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:36.953196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:36.955942 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:36.956455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:36.956896 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:36.957593 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:36.958043 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:36.958468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:36.994237 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4db0d60a-7da6-4a41-a7fb-72b1cb5aa327 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050749 Aug 05 15:36:37.001093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 291/593] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:36:36 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 15:36:37.097153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:37.105974 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:37.107506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:37.108755 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2fa1499b-404c-40cb-9ebe-0348139f8dfd tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1720 microversion: 2.20 time: 0.170834 Aug 05 15:36:37.109295 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 303/594] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:36 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:37.115795 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:37.118092 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:37.123948 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:37.124471 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:37.124902 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:37.125577 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:37.126021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:37.126435 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:37.154937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ea9166be-2c37-49a2-9343-0e6e7d83cdb2 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042958 Aug 05 15:36:37.155477 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 292/595] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:36:37 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 15:36:37.216043 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:37.216567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:37.222412 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:37.222893 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:37.223329 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:37.224018 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:37.224496 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:37.224924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:37.248577 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Going to try to terminate instance {{(pid=118723) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:36:37.673063 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-74092e12-f3f3-4a08-82bc-9d77cdf86926 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 204 len: 0 microversion: 2.1 time: 0.460432 Aug 05 15:36:37.673652 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 304/596] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:36:37 2022] DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:36:37.682120 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:37.683086 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:37.688600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:37.689081 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:37.689513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:37.690198 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:37.690647 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:37.691070 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:37.818153 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:37.826175 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a4019bc0-e1f3-44a7-850c-ab9c3f570856 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1674 microversion: 2.1 time: 0.148320 Aug 05 15:36:37.826732 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 293/597] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:37 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:37.840634 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:37.841364 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:37.847694 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:37.848209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:37.848652 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:37.849347 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:37.849806 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:37.850237 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:37.911095 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:37.918935 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-30bb13cb-961b-4281-8c59-2a0c6ed8e1ca tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1299 microversion: 2.1 time: 0.082483 Aug 05 15:36:37.919501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 305/598] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:37 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:38.132685 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:38.133289 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:38.139332 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:38.146231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:38.146231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:38.146231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:38.146231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:38.146666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:38.281300 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:38.289957 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:38.291442 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:38.292598 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-49d18fdd-ef25-4fce-b63e-40ff88acf9e3 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1720 microversion: 2.20 time: 0.164074 Aug 05 15:36:38.293151 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 294/599] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:38 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:38.846790 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:38.847451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:38.853909 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:38.854386 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:38.854820 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:38.855501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:38.855953 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:38.856401 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:38.940043 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:38.940786 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:38.948149 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:38.948737 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:38.949241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:38.950011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:38.950528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:38.951021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:38.970286 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:38.986057 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:38.988160 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:38.988160 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:38.988160 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lazy-loading 'fault' on Instance uuid fef464ba-20cc-4ffc-b424-083439bfa6d8 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:36:38.995409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:39.003174 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e72c2ad4-6bf8-45d2-8fad-a99ab16ff62d tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1674 microversion: 2.1 time: 0.160186 Aug 05 15:36:39.003743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 306/600] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:38 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:39.030691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:39.038326 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-847ec570-eefb-4e7a-809b-535c8b787830 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1304 microversion: 2.1 time: 0.102082 Aug 05 15:36:39.038885 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 295/601] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:38 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:39.316342 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:39.316953 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:39.323570 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:39.324056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:39.324524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:39.325217 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:39.325672 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:39.326107 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:39.454571 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:39.458053 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:39.462796 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:39.464347 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:39.470569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-26ff88e8-1345-497b-bfd5-0a1ae8c0726d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1720 microversion: 2.20 time: 0.153196 Aug 05 15:36:39.470569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 307/602] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:39 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:40.025858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:40.026586 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:40.033064 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.043642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.043642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.043642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.043642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.044014 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.059153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:40.059930 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:40.068896 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.069660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.070104 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.070815 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.071280 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.071859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.105026 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.105595 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.105995 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.106988 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lazy-loading 'fault' on Instance uuid fef464ba-20cc-4ffc-b424-083439bfa6d8 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:36:40.159361 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:40.177794 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4f8e91e9-f275-489a-9ef8-6523e5ade3d7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 200 len: 1304 microversion: 2.1 time: 0.122614 Aug 05 15:36:40.179252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 308/603] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:40 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:40.208264 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:40.219830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d17f3edc-90a6-4312-8218-5c1c396c1237 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1674 microversion: 2.1 time: 0.198655 Aug 05 15:36:40.220453 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 296/604] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:40 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:40.273257 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-38ab8547-0ad2-435a-8670-335e0ed551a9 req-d73c040c-67e9-407f-8aa7-6c938fc93c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a10dbd4-0580-46dc-821e-98476c654d5a", "name": "network-vif-unplugged", "status": "completed", "tag": "b7a39fee-4688-4052-adea-986dac23d796"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:40.282681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-38ab8547-0ad2-435a-8670-335e0ed551a9 req-d73c040c-67e9-407f-8aa7-6c938fc93c07 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.284807 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-38ab8547-0ad2-435a-8670-335e0ed551a9 req-d73c040c-67e9-407f-8aa7-6c938fc93c07 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.284807 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-38ab8547-0ad2-435a-8670-335e0ed551a9 req-d73c040c-67e9-407f-8aa7-6c938fc93c07 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.294382 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-38ab8547-0ad2-435a-8670-335e0ed551a9 req-d73c040c-67e9-407f-8aa7-6c938fc93c07 service nova] Creating event network-vif-unplugged:b7a39fee-4688-4052-adea-986dac23d796 for instance 8a10dbd4-0580-46dc-821e-98476c654d5a on hv-cinder-84989 Aug 05 15:36:40.299034 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-38ab8547-0ad2-435a-8670-335e0ed551a9 req-d73c040c-67e9-407f-8aa7-6c938fc93c07 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106057 Aug 05 15:36:40.302057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 309/605] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:36:40.492152 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:40.492679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:40.499908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.501409 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.502105 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.503036 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.503563 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.504055 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.645355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:40.653631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:40.655170 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:40.656515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-70fdad88-c703-4476-a05f-36913206b45f tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1723 microversion: 2.20 time: 0.168433 Aug 05 15:36:40.674075 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 297/606] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:40 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:40.681785 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f190c250-58ae-45d7-8c1c-f7b2edd3263e"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:40.684337 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:40.693937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.693937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.693937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:40.695037 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:40.695694 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:40.696196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.198806 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:41.199449 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: fef464ba-20cc-4ffc-b424-083439bfa6d8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:41.205867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.206342 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.206767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.207450 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.207890 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.208330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.221560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] HTTP exception thrown: Instance fef464ba-20cc-4ffc-b424-083439bfa6d8 could not be found. Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Request method failure captured: Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 HTTP/1.1 Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TjvmpGK-G7ngmsWWlCfz7DNSlcCnokZgr_NgZeXspmZV-DINtrRHNu9n7rsmMwtJ0-TFkR9iDlboIjgdBFf6BwQPG-jfCJUDxvbsevR5CZ6DM6mBzaWcTh1D_K3iVIyDxpcGeqrh23WJvf4s6epMxSeAQcHqE5Ti3ojrKy9vsUeV4E Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 07cd370ebabf4f048e72f7b1fbadcb08 Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-VolumesActionsTest-1080612332 Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:36:41.223199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07cd370ebabf4f048e72f7b1fbadcb08", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07cd370ebabf4f048e72f7b1fbadcb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07cd370ebabf4f048e72f7b1fbadcb08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07cd370ebabf4f048e72f7b1fbadcb08"}]}] Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-VolumesActionsTest-1080612332 Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 07cd370ebabf4f048e72f7b1fbadcb08 Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-VolumesActionsTest-1080612332 Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-VolumesActionsTest-1080612332-project Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: ff040e1f99bf46d48446e2e9c0deb9cc Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-VolumesActionsTest-1080612332-project Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance fef464ba-20cc-4ffc-b424-083439bfa6d8 could not be found. Aug 05 15:36:41.226418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'fef464ba-20cc-4ffc-b424-083439bfa6d8'} Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef464ba-20cc-4ffc-b424-083439bfa6d8 could not be found. Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:36:41.227219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef464ba-20cc-4ffc-b424-083439bfa6d8 could not be found. Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef464ba-20cc-4ffc-b424-083439bfa6d8 could not be found. Aug 05 15:36:41.228583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:41.229663 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Returning 404 to user: Instance fef464ba-20cc-4ffc-b424-083439bfa6d8 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:36:41.229663 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e2dcd4f2-2a57-491d-b568-7c9a7d212ec3 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8" status: 404 len: 111 microversion: 2.1 time: 0.029729 Aug 05 15:36:41.229663 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 298/607] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:41 2022] GET /compute/v2.1/servers/fef464ba-20cc-4ffc-b424-083439bfa6d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 15:36:41.241036 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:41.242164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:41.248244 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.248730 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.249166 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.249859 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.250306 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.250726 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.337564 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e80222936d4427909414a78e1dc489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9776de9e6d341fdbf7ac4fa70b994aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:41.346378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-924a532b-2c77-4816-9763-78a26912c4da tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 200 len: 1606 microversion: 2.1 time: 0.109068 Aug 05 15:36:41.346953 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 299/608] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:41 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 1606 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:41.352331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-559114265", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "networks": [{"uuid": "aae8b9f3-a089-477d-a5f7-c4cd568027cc"}]}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:41.436007 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] validate_networks() for [('aae8b9f3-a089-477d-a5f7-c4cd568027cc', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:36:41.743029 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-196c9b7d-9ac1-46f9-95dd-801b2c9be74d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.066376 Aug 05 15:36:41.744311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 310/609] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Aug 5 15:36:40 2022] POST /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/os-volume_attachments => generated 188 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 15:36:41.854233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-3f09b63e-3cb6-48cc-97ca-0847a83fa2f0 req-ae1a3b4f-4f11-47fd-9ae7-e03cd4a312ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adba90d0-6910-4741-a3c7-a7fa5ffbda9c", "name": "network-vif-deleted", "tag": "c2647432-cbf5-4f2d-a719-a7acfd914103"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:41.867374 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-3f09b63e-3cb6-48cc-97ca-0847a83fa2f0 req-ae1a3b4f-4f11-47fd-9ae7-e03cd4a312ed service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.867965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-3f09b63e-3cb6-48cc-97ca-0847a83fa2f0 req-ae1a3b4f-4f11-47fd-9ae7-e03cd4a312ed service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.868535 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-3f09b63e-3cb6-48cc-97ca-0847a83fa2f0 req-ae1a3b4f-4f11-47fd-9ae7-e03cd4a312ed service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.881526 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-3f09b63e-3cb6-48cc-97ca-0847a83fa2f0 req-ae1a3b4f-4f11-47fd-9ae7-e03cd4a312ed service nova] Creating event network-vif-deleted:c2647432-cbf5-4f2d-a719-a7acfd914103 for instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c on hv-cinder-84989 Aug 05 15:36:41.904741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:36:41.904741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:36:41.904741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:36:41.904741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:36:41.904741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:36:41.907375 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-3f09b63e-3cb6-48cc-97ca-0847a83fa2f0 req-ae1a3b4f-4f11-47fd-9ae7-e03cd4a312ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161465 Aug 05 15:36:41.908096 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 311/610] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:41.913533 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:41.914346 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:41.916249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.916823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.917882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.918687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.919219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.919652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.920941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.921519 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.922022 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.922855 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:41.923374 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:41.923801 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:41.938522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Getting quotas for project 07cd370ebabf4f048e72f7b1fbadcb08. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:36:41.942731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Getting quotas for user ff040e1f99bf46d48446e2e9c0deb9cc and project 07cd370ebabf4f048e72f7b1fbadcb08. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:36:41.956681 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:36:41.959392 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:36:42.111598 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ce969571-5602-4291-87ac-8872e56274da tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763235 Aug 05 15:36:42.112181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 300/611] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:36:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:36:42.123735 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c2c005e7-654e-4ae5-89c8-cc483d7ea703 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:42.126154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c2c005e7-654e-4ae5-89c8-cc483d7ea703 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:42.186308 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c2c005e7-654e-4ae5-89c8-cc483d7ea703 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:42.195213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c2c005e7-654e-4ae5-89c8-cc483d7ea703 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1213 microversion: 2.1 time: 0.074600 Aug 05 15:36:42.196271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 301/612] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:42 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:42.369343 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:42.370139 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:42.376491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:42.377187 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:42.377781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:42.378641 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:42.379241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:42.379936 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:42.396366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] HTTP exception thrown: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Request method failure captured: Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c HTTP/1.1 Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te8lLG7j7jKnAWh-6EqFNESlZhodfu1PKUmepHO7I3lSbnDKVHUdhb1IhI30wSE0uo9vAvgu0Xz5pTmCeDRgTeOl1944zcS0qQMwD403tEGtDpqE4nXLTvLqPt4Djfi3O0GPU9nw3qUoRvjXfbK4lq4231qR2QV-2uNJd29-DL6YYE Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:36:42.397952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9776de9e6d341fdbf7ac4fa70b994aa", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9776de9e6d341fdbf7ac4fa70b994aa"}]}] Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 04e80222936d4427909414a78e1dc489 Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:42.402949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'adba90d0-6910-4741-a3c7-a7fa5ffbda9c'} Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:36:42.403672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:42.404872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:42.405936 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Returning 404 to user: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:36:42.405936 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0d4cbd46-8d1d-4608-a508-6dae18e280e5 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 404 len: 111 microversion: 2.1 time: 0.034519 Aug 05 15:36:42.405936 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 302/613] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:42 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 15:36:42.408124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f9667d93-c7e4-471b-8e90-2367f9a04dc9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '.version_select at 0x7fcb14e65820>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:42.508927 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f9667d93-c7e4-471b-8e90-2367f9a04dc9 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-798667578" status: 202 len: 0 microversion: 2.1 time: 0.104208 Aug 05 15:36:42.509507 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 303/614] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 15:36:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-798667578 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 15:36:42.536170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f188eb84-0b55-4740-9d18-34322d547018 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/os-volume_attachments/f190c250-58ae-45d7-8c1c-f7b2edd3263e" status: 202 len: 0 microversion: 2.20 time: 0.626558 Aug 05 15:36:42.536843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 312/615] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Aug 5 15:36:41 2022] DELETE /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/os-volume_attachments/f190c250-58ae-45d7-8c1c-f7b2edd3263e => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:36:42.619248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:42.620088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:42.629690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:42.629690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:42.629690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:42.629690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:42.630030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:42.630545 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:42.661090 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118722) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 15:36:42.961855 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-80a2eb97-e358-4550-b007-3ec6fa35e3ee tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "POST /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/action" status: 202 len: 0 microversion: 2.20 time: 0.347096 Aug 05 15:36:42.962854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 304/616] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 5 15:36:42 2022] POST /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:36:42.972005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:42.973635 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:42.983663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:42.983663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:42.983663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:42.983663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:42.983962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:42.983962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:43.179304 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:43.188879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:43.190550 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:43.191722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e00a7956-2ae7-497c-9ef9-d03917cde48a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1671 microversion: 2.20 time: 0.224406 Aug 05 15:36:43.204229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 313/617] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:42 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:43.217469 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:43.218290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:43.224683 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:43.225244 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:43.226411 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:43.227077 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:43.227536 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:43.227997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:43.320296 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:43.328159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c03dcfb2-a88d-4913-90f9-c5c175432d7e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1217 microversion: 2.1 time: 0.114115 Aug 05 15:36:43.341503 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 305/618] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:43 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:44.216275 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:44.216887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:44.223358 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:44.223835 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:44.224303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:44.224999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:44.225996 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:44.226623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:44.349510 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:44.358568 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:44.366738 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:44.367238 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:44.367753 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:44.368678 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:44.369163 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:44.369826 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:44.377139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:44.386544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:44.388773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:44.390017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8e013c23-6359-4443-a801-1c5b0a450065 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1673 microversion: 2.20 time: 0.177718 Aug 05 15:36:44.390939 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 314/619] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:44 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:44.438862 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:44.446491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-da8b6f7e-c409-42ec-9cf8-6e370f3de473 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1271 microversion: 2.1 time: 0.100921 Aug 05 15:36:44.447050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 306/620] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:44 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:45.417738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:45.418338 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:45.427032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:45.429774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:45.429774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:45.429774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:45.429774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:45.430310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:45.467872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:45.468758 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:45.475107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:45.476349 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:45.476951 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:45.477802 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:45.478415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:45.479116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:45.632208 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:45.640868 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:45.642459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:45.643698 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7a91a939-8c70-468a-a9bd-b0c69b909f97 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.230407 Aug 05 15:36:45.644508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 315/621] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:45 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:45.664033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:45.672229 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e522d037-28e0-4b00-99cd-771084a9bc30 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.207990 Aug 05 15:36:45.672795 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 307/622] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:45 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:45.702366 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-40cbd2ef-457d-4ee4-80ab-e7acbc4c3d29 req-c4a64274-1f58-4bd7-b375-4a329021a48a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d625ed-7eae-4709-807a-e8f31d867223", "tag": "ac766b47-3986-4402-a256-ed26abd4fa9c"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:45.712620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-40cbd2ef-457d-4ee4-80ab-e7acbc4c3d29 req-c4a64274-1f58-4bd7-b375-4a329021a48a service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:45.713243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-40cbd2ef-457d-4ee4-80ab-e7acbc4c3d29 req-c4a64274-1f58-4bd7-b375-4a329021a48a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:45.713689 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-40cbd2ef-457d-4ee4-80ab-e7acbc4c3d29 req-c4a64274-1f58-4bd7-b375-4a329021a48a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:45.732647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-40cbd2ef-457d-4ee4-80ab-e7acbc4c3d29 req-c4a64274-1f58-4bd7-b375-4a329021a48a service nova] Creating event network-changed:ac766b47-3986-4402-a256-ed26abd4fa9c for instance 09d625ed-7eae-4709-807a-e8f31d867223 on hv-cinder-84989 Aug 05 15:36:45.740502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-40cbd2ef-457d-4ee4-80ab-e7acbc4c3d29 req-c4a64274-1f58-4bd7-b375-4a329021a48a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041734 Aug 05 15:36:45.742325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 316/623] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:45.997560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:45.998082 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:46.006509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:46.007284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:46.009591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:46.009591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:46.010077 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:46.011318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:46.028662 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] HTTP exception thrown: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Request method failure captured: Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c HTTP/1.1 Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te8lLG7j7jKnAWh-6EqFNESlZhodfu1PKUmepHO7I3lSbnDKVHUdhb1IhI30wSE0uo9vAvgu0Xz5pTmCeDRgTeOl1944zcS0qQMwD403tEGtDpqE4nXLTvLqPt4Djfi3O0GPU9nw3qUoRvjXfbK4lq4231qR2QV-2uNJd29-DL6YYE Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:36:46.030606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9776de9e6d341fdbf7ac4fa70b994aa", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9776de9e6d341fdbf7ac4fa70b994aa"}]}] Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 04e80222936d4427909414a78e1dc489 Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.031864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'adba90d0-6910-4741-a3c7-a7fa5ffbda9c'} Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:36:46.032631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.033770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.037316 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Returning 404 to user: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:36:46.039178 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4cd2666d-4ed3-4238-aee2-c9e699c8f972 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 404 len: 111 microversion: 2.1 time: 0.046316 Aug 05 15:36:46.040367 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 308/624] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:36:45 2022] DELETE /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:36:46.052240 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:46.053724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: adba90d0-6910-4741-a3c7-a7fa5ffbda9c] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:46.065703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:46.066799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:46.067834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:46.070071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:46.071202 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:46.072161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:46.096620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] HTTP exception thrown: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Request method failure captured: Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c HTTP/1.1 Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7Te8lLG7j7jKnAWh-6EqFNESlZhodfu1PKUmepHO7I3lSbnDKVHUdhb1IhI30wSE0uo9vAvgu0Xz5pTmCeDRgTeOl1944zcS0qQMwD403tEGtDpqE4nXLTvLqPt4Djfi3O0GPU9nw3qUoRvjXfbK4lq4231qR2QV-2uNJd29-DL6YYE Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:36:46.100254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9776de9e6d341fdbf7ac4fa70b994aa", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9776de9e6d341fdbf7ac4fa70b994aa"}]}] Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 04e80222936d4427909414a78e1dc489 Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.102311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': 'adba90d0-6910-4741-a3c7-a7fa5ffbda9c'} Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:36:46.103117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. Aug 05 15:36:46.104523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:46.106930 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Returning 404 to user: Instance adba90d0-6910-4741-a3c7-a7fa5ffbda9c could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:36:46.107088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c914f372-b356-4d19-9844-4dd8aaf8aed7 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c" status: 404 len: 111 microversion: 2.1 time: 0.060902 Aug 05 15:36:46.110875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 317/625] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:46 2022] GET /compute/v2.1/servers/adba90d0-6910-4741-a3c7-a7fa5ffbda9c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:36:46.667026 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:46.667692 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:46.686769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:46.687183 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:46.687623 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:46.688745 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:46.689203 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:46.689633 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:46.693273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:46.693894 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:46.701291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:46.702016 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:46.702227 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:46.702908 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:46.703358 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:46.703778 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:46.911173 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:46.934637 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:46.934908 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6e89b2f8-d2a7-4594-af41-8ed3f725c9c6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.230178 Aug 05 15:36:46.934908 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 318/626] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:46 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:46.935099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:46.935099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:46.935099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ce75d06e-cf14-4e87-9242-c65c770205b0 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.265750 Aug 05 15:36:46.935508 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 309/627] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:46 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:47.473523 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:47.474115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:47.481119 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:47.481688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:47.482460 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:47.483266 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:47.483731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:47.484195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:47.500026 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] HTTP exception thrown: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Request method failure captured: Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: DELETE /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 HTTP/1.1 Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7Te8lLG7j7jKnAWh-6EqFNESlZhodfu1PKUmepHO7I3lSbnDKVHUdhb1IhI30wSE0uo9vAvgu0Xz5pTmCeDRgTeOl1944zcS0qQMwD403tEGtDpqE4nXLTvLqPt4Djfi3O0GPU9nw3qUoRvjXfbK4lq4231qR2QV-2uNJd29-DL6YYE Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:36:47.501622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9776de9e6d341fdbf7ac4fa70b994aa", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9776de9e6d341fdbf7ac4fa70b994aa"}]}] Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 04e80222936d4427909414a78e1dc489 Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.511770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '12163066-5037-46d7-8e66-c900aead6e69'} Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:36:47.512696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.514091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.515354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Returning 404 to user: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:36:47.515354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-dfa53862-a00c-425a-942d-1962b059423c tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "DELETE /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 404 len: 111 microversion: 2.1 time: 0.033778 Aug 05 15:36:47.515354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 319/628] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:36:47 2022] DELETE /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:36:47.515571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:47.515571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] [instance: 12163066-5037-46d7-8e66-c900aead6e69] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:47.519491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:47.519982 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:47.520456 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:47.521167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:47.521774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:47.522208 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:47.536673 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] HTTP exception thrown: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Request method failure captured: Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 HTTP/1.1 Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te8lLG7j7jKnAWh-6EqFNESlZhodfu1PKUmepHO7I3lSbnDKVHUdhb1IhI30wSE0uo9vAvgu0Xz5pTmCeDRgTeOl1944zcS0qQMwD403tEGtDpqE4nXLTvLqPt4Djfi3O0GPU9nw3qUoRvjXfbK4lq4231qR2QV-2uNJd29-DL6YYE Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:36:47.539074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9776de9e6d341fdbf7ac4fa70b994aa", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9776de9e6d341fdbf7ac4fa70b994aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9776de9e6d341fdbf7ac4fa70b994aa"}]}] Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: f9776de9e6d341fdbf7ac4fa70b994aa Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1471154262 Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 04e80222936d4427909414a78e1dc489 Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeTestJSON-1471154262-project Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.542021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '12163066-5037-46d7-8e66-c900aead6e69'} Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:36:47.542990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. Aug 05 15:36:47.544544 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:36:47.545839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] Returning 404 to user: Instance 12163066-5037-46d7-8e66-c900aead6e69 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:36:47.545839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a0012372-1a3d-418c-9ecb-2540446ae604 tempest-AttachVolumeTestJSON-1471154262 tempest-AttachVolumeTestJSON-1471154262-project] 10.222.0.40 "GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69" status: 404 len: 111 microversion: 2.1 time: 0.032801 Aug 05 15:36:47.552713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 310/629] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:47 2022] GET /compute/v2.1/servers/12163066-5037-46d7-8e66-c900aead6e69 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:36:47.941572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:47.942362 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:47.950397 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:47.952243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:47.952243 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:47.952778 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:47.953894 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:47.954329 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:47.959458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:47.959458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:47.966652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:47.967391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:47.968311 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:47.969339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:47.969952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:47.970538 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:48.288295 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:48.295155 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:48.306469 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:48.306751 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b1a0999e-abe5-48b5-beda-41ef759666f6 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.369174 Aug 05 15:36:48.307528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 320/630] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:47 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:48.308958 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:48.310240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3e19b4f3-4d3c-44fd-98c6-c22ccd012f1a tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.356743 Aug 05 15:36:48.310791 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 311/631] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:47 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:49.328805 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:49.329456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:49.334040 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:49.334651 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:49.337084 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:49.337646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:49.338314 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:49.339244 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:49.339921 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:49.340695 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:49.346145 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:49.350631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:49.351144 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:49.353201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:49.358488 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:49.359004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:49.608154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:49.615643 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:49.620487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:49.622218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:49.623511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2410fc7f-dacd-4e21-b897-0d1c900fdb49 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.294538 Aug 05 15:36:49.624778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 312/632] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:49 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:49.625426 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-27f48972-41bc-4a0f-b698-b320adf17204 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.300215 Aug 05 15:36:49.626502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 321/633] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:49 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:50.664527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:50.664527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:50.668902 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:50.670601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:50.672809 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:50.674488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:50.674938 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:50.676718 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:50.677188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:50.677617 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:50.678616 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:50.679423 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:50.679865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:50.680600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:50.681297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:50.681769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:50.718063 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:50.937141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:50.947083 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:50.948958 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:50.950047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-aa43b2e3-aeb7-417c-985a-d2f181413e5c tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.298795 Aug 05 15:36:50.951741 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:50.961208 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 313/634] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:50 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:50.970595 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6321f20a-dddc-4732-9b96-1fb79bab31e9 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.319199 Aug 05 15:36:50.971184 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 322/635] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:50 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:51.974862 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:51.978259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:51.980781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:51.990838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:51.992823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:51.992823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:51.993153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:51.993610 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:51.993610 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:51.993766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:51.994582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:52.003386 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:52.004259 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:52.004949 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:52.005889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:52.006616 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:52.007323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:52.191537 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=8 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:52.372844 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:52.402923 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6c28161a-cad0-47e0-837c-add4d6cab269 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.398211 Aug 05 15:36:52.402923 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 323/636] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:51 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:52.409335 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:52.423773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:52.425961 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:52.427328 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3ab75411-8e25-4ea7-92cf-cace4a7203de tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.456397 Aug 05 15:36:52.428428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 314/637] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:51 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:53.410834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:53.411690 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:53.420575 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:53.421698 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:53.422618 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:53.423664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:53.424475 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:53.429457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:53.455054 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:53.460852 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:53.474263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:53.474767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:53.475210 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:53.481442 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:53.482032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:53.483782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:53.676998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:53.689199 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5f3ce7b9-9c36-4e2e-b2a0-bab03de2bdf5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.284230 Aug 05 15:36:53.697131 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 324/638] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:53 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:53.710415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:53.723615 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:53.723615 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:53.723615 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f9290cf1-dc7f-4180-b8d7-f2a31e7f8021 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.272649 Aug 05 15:36:53.724134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 315/639] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:53 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:54.716075 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:54.716812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:54.723363 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:54.723930 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:54.724482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:54.725276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:54.725915 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:54.726301 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:54.730760 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:36:54.733205 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dac76a6f-3991-43ff-9e18-85ff46bf1c38 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Action: 'create', calling method: .version_select at 0x7fcb14cc7790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-626507445"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:54.865001 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:54.872906 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5ccdddab-198c-4de5-9279-f1a5e333e8e8 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.161343 Aug 05 15:36:54.873468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 316/640] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:54 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:54.877807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:54.878394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:54.884839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:54.885301 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:54.885838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:54.886522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:54.886966 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:54.887381 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:55.013576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:55.021622 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:55.023122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:55.024288 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5f5be6bc-bb1b-4b18-9ea9-1d34dffa34d7 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.149897 Aug 05 15:36:55.024849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 317/641] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:54 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:55.320754 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-dac76a6f-3991-43ff-9e18-85ff46bf1c38 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.714488 Aug 05 15:36:55.321367 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 325/642] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Aug 5 15:36:54 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 716 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 15:36:55.333531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-96fa46af-3d79-41a5-8701-9b7fc7cb5f6f tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14ee8550>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:55.381575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-96fa46af-3d79-41a5-8701-9b7fc7cb5f6f tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c" status: 200 len: 344 microversion: 2.1 time: 0.051604 Aug 05 15:36:55.382107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 318/643] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:36:55 2022] GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:55.894002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:55.894695 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:55.901913 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:55.902397 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:55.902833 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:55.903528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:55.903981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:55.904430 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:56.035650 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:56.043350 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-dcadad72-47c7-4c63-adcc-812d5d5e27ae tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.154025 Aug 05 15:36:56.043914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 326/644] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:55 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:36:56.046687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:56.047290 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:56.053904 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:56.054378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:56.054810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:56.055492 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:56.055938 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:56.056552 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:56.187137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:56.194981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:56.196561 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:56.197691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-296f9b1e-d507-452c-988a-033300411362 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.154878 Aug 05 15:36:56.198232 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 319/645] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:56 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:56.395135 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9277c587-5f97-48ba-855f-eebf79ccf7b2 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d2cc10>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:56.441308 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9277c587-5f97-48ba-855f-eebf79ccf7b2 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c" status: 200 len: 345 microversion: 2.1 time: 0.050301 Aug 05 15:36:56.441858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 327/646] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:36:56 2022] GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:56.454122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-be3f92bf-add6-41d8-88ef-0a2472c79165 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Action: 'create', calling method: .version_select at 0x7fcb14d95700>, body: {"snapshot": {"volume_id": "14cb9a92-5d5b-47f0-a0fc-54893382981c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-484662967"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:36:56.876222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-be3f92bf-add6-41d8-88ef-0a2472c79165 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.425858 Aug 05 15:36:56.876903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 320/647] 10.222.0.40 () {60 vars in 1162 bytes} [Fri Aug 5 15:36:56 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:56.887416 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-36585eb1-eae9-41a4-9e53-2405e9577e28 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14da9700>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:56.917265 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-36585eb1-eae9-41a4-9e53-2405e9577e28 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 200 len: 286 microversion: 2.1 time: 0.033715 Aug 05 15:36:56.918050 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 328/648] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:36:56 2022] GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:56.932372 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3c50a7f1-7e7a-4732-aa62-ad5817efa802 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14e19430>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:56.971110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3c50a7f1-7e7a-4732-aa62-ad5817efa802 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.042496 Aug 05 15:36:56.972535 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 321/649] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Aug 5 15:36:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:56.983872 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-38e7fa50-3f7a-4e2b-884e-8966c3748ac5 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14cc7040>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:57.013914 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-38e7fa50-3f7a-4e2b-884e-8966c3748ac5 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 200 len: 286 microversion: 2.1 time: 0.033842 Aug 05 15:36:57.014471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 329/650] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:36:56 2022] GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:57.064523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:57.065813 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:57.071886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:57.072404 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:57.072845 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:57.073540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:57.073995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:57.074422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:57.202327 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:57.209602 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5d5650f7-1e7f-41a6-8125-d7030762b16f tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.149486 Aug 05 15:36:57.210088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 322/651] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:57 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:57.220242 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:57.220911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:57.227353 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:57.227833 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:57.228304 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:57.228994 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:57.229477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:57.229870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:57.358251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:57.366258 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:57.367803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:57.369060 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-337badf4-536e-4ac3-8ef6-dcb3ab3cb8c4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.152673 Aug 05 15:36:57.376694 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 330/652] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:57 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:36:58.026816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-46626b11-0878-4f35-8fb6-93b5552242f1 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14e48820>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:58.057291 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-46626b11-0878-4f35-8fb6-93b5552242f1 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 200 len: 286 microversion: 2.1 time: 0.034392 Aug 05 15:36:58.057853 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 323/653] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:36:58 2022] GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:58.231786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:58.232452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:58.239105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:58.239650 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:58.240110 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:58.240837 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:58.241364 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:58.241815 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:58.378113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:58.386354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3ee019fd-5988-4407-8dc0-a3628717315d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.158660 Aug 05 15:36:58.386937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 331/654] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:58 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:58.401081 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:58.401938 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:58.409313 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:58.410178 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:58.410691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:58.411419 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:58.411877 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:58.412365 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:58.562455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:58.570651 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:58.572114 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:58.573257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-fdc6eba4-d51a-4e91-948c-6638bfeffc0b tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.177783 Aug 05 15:36:58.573807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 324/655] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:58 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:36:59.068866 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-444ca4ad-0aa4-41bf-9bc6-766df07ce257 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d71430>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:59.099903 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-444ca4ad-0aa4-41bf-9bc6-766df07ce257 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 200 len: 286 microversion: 2.1 time: 0.034869 Aug 05 15:36:59.100513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 332/656] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:36:59 2022] GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:36:59.408102 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:59.409237 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:59.415161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:59.415641 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:59.416096 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:59.416789 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:59.417241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:59.417664 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:59.552043 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:59.560172 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-856983bf-2201-4b64-ad5d-7561d5a432df tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.155890 Aug 05 15:36:59.560742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 325/657] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:36:59 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:36:59.598297 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:36:59.598968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:36:59.605773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:59.606269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:59.606716 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:59.607420 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:36:59.607878 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:36:59.608331 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:36:59.735250 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:59.743166 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:59.745390 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:36:59.746538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e00dbe7a-68a3-43a0-9136-74bf76a91978 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.152906 Aug 05 15:36:59.747093 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 333/658] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:36:59 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:37:00.112793 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5f3230ff-9c2a-438d-ae6d-e0cef07a8e7b tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d3e0d0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:00.141444 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5f3230ff-9c2a-438d-ae6d-e0cef07a8e7b tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 200 len: 286 microversion: 2.1 time: 0.032525 Aug 05 15:37:00.142000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 326/659] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:37:00 2022] GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:37:00.583052 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:00.583660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:00.585510 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:37:00.590723 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:00.591200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:00.591641 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:00.592355 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:00.592835 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:00.593256 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:00.721792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:00.729141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6a8504f7-c629-4883-8e8e-4095a02b737e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.149939 Aug 05 15:37:00.729701 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 334/660] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:00 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:00.770457 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:00.771059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:00.776985 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:00.777455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:00.777879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:00.778553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:00.778996 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:00.779410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:00.910871 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:00.918959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:00.920480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:00.921628 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3cc15726-5413-4210-a25c-e4c96d5209cf tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.155920 Aug 05 15:37:00.922182 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 327/661] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:00 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:37:01.154759 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5d0ccfef-552a-4691-8e6e-f078c2c4248d tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d35c10>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:01.183620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5d0ccfef-552a-4691-8e6e-f078c2c4248d tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 200 len: 287 microversion: 2.1 time: 0.032687 Aug 05 15:37:01.184229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 335/662] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:37:01 2022] GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:37:01.194964 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-bbd97232-46e9-4d33-89f2-a1a535ae480b tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d3e310>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:01.320384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-bbd97232-46e9-4d33-89f2-a1a535ae480b tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 202 len: 0 microversion: 2.1 time: 0.129082 Aug 05 15:37:01.320945 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 328/663] 10.222.0.40 () {58 vars in 1254 bytes} [Fri Aug 5 15:37:01 2022] DELETE /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:37:01.329579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b0a2fcc4-3832-444e-a037-449c48901d9c tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d2c550>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:01.359009 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b0a2fcc4-3832-444e-a037-449c48901d9c tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 200 len: 286 microversion: 2.1 time: 0.033247 Aug 05 15:37:01.359573 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 336/664] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:37:01 2022] GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:37:01.750001 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:01.750529 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:01.753440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:37:01.756699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:01.757172 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:01.757600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:01.758320 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:01.758765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:01.759179 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:01.889635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:01.897355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-66db81eb-f5ee-440c-88f2-55a1d6dd294a tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.151404 Aug 05 15:37:01.897908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 329/665] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:01 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:01.945288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:01.945922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:01.954864 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:01.955348 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:01.955787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:01.956508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:01.956968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:01.957393 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:02.081390 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:02.089799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:02.091290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:02.092476 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2c89f56a-d0f2-4bc8-89fd-e7f5e2e00eac tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.151519 Aug 05 15:37:02.093030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 337/666] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:01 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:37:02.371540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a2b65e27-a366-49a4-9b06-f25aa19bfdc4 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d3eee0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:02.397384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-a2b65e27-a366-49a4-9b06-f25aa19bfdc4 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] HTTP exception thrown: Snapshot c0835fbf-547b-43c9-a7ad-c5e85f633792 could not be found. Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a2b65e27-a366-49a4-9b06-f25aa19bfdc4 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Request method failure captured: Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 HTTP/1.1 Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TkWRu772gJjZQ5K5HCVe1WSt0XTLGt2MLzYBn0Fc3v-L6FxsGBp9-juNbafseELqhO9lWIhyCUOh-L1jO8DpIBaiudbvu4Yst23V0sX2a5pgMuXTIN_X1p7mBN4I_NoY7VaR4eUrgDT12-TgbdLSjzA0_PNWV_3dESVaWTqDL787w0 Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 5a1e917d8dfe4aee9d739d4df1b268fc Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:37:02.399686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a1e917d8dfe4aee9d739d4df1b268fc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a1e917d8dfe4aee9d739d4df1b268fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a1e917d8dfe4aee9d739d4df1b268fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a1e917d8dfe4aee9d739d4df1b268fc"}]}] Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 5a1e917d8dfe4aee9d739d4df1b268fc Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-VolumesSnapshotsTestJSON-1031681263-project Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 561df7f148964b27978333ef1422b9bf Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1031681263-project Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Snapshot c0835fbf-547b-43c9-a7ad-c5e85f633792 could not be found. Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'c0835fbf-547b-43c9-a7ad-c5e85f633792'} Aug 05 15:37:02.401399 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c0835fbf-547b-43c9-a7ad-c5e85f633792 could not be found. (HTTP 404) (Request-ID: req-b5b6a0fb-0264-4e5e-984e-a49bf0a2e4d8) Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:02.402455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:37:02.403822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c0835fbf-547b-43c9-a7ad-c5e85f633792 could not be found. Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 15:37:02.405112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c0835fbf-547b-43c9-a7ad-c5e85f633792 could not be found. Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c0835fbf-547b-43c9-a7ad-c5e85f633792 could not be found. Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a2b65e27-a366-49a4-9b06-f25aa19bfdc4 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Returning 404 to user: Snapshot c0835fbf-547b-43c9-a7ad-c5e85f633792 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:02.406505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a2b65e27-a366-49a4-9b06-f25aa19bfdc4 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792" status: 404 len: 111 microversion: 2.1 time: 0.034167 Aug 05 15:37:02.407553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 330/667] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:37:02 2022] GET /compute/v2.1/os-snapshots/c0835fbf-547b-43c9-a7ad-c5e85f633792 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:37:02.410130 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b6fe13eb-f147-4f07-a26d-7a43863f63e8 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14f2a3a0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:02.433405 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-9b32dcd8-b8f2-4a9f-afb0-e531d57c1377 req-6a69d79d-275f-453a-b0fe-ee4bdc51bceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a10dbd4-0580-46dc-821e-98476c654d5a", "name": "network-vif-plugged", "status": "completed", "tag": "b7a39fee-4688-4052-adea-986dac23d796"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:37:02.445330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-9b32dcd8-b8f2-4a9f-afb0-e531d57c1377 req-6a69d79d-275f-453a-b0fe-ee4bdc51bceb service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:02.445330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-9b32dcd8-b8f2-4a9f-afb0-e531d57c1377 req-6a69d79d-275f-453a-b0fe-ee4bdc51bceb service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:02.445330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-9b32dcd8-b8f2-4a9f-afb0-e531d57c1377 req-6a69d79d-275f-453a-b0fe-ee4bdc51bceb service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:02.455994 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-9b32dcd8-b8f2-4a9f-afb0-e531d57c1377 req-6a69d79d-275f-453a-b0fe-ee4bdc51bceb service nova] Creating event network-vif-plugged:b7a39fee-4688-4052-adea-986dac23d796 for instance 8a10dbd4-0580-46dc-821e-98476c654d5a on hv-cinder-84989 Aug 05 15:37:02.461167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-9b32dcd8-b8f2-4a9f-afb0-e531d57c1377 req-6a69d79d-275f-453a-b0fe-ee4bdc51bceb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032130 Aug 05 15:37:02.461754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 331/668] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:37:02.589355 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b6fe13eb-f147-4f07-a26d-7a43863f63e8 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c" status: 202 len: 0 microversion: 2.1 time: 0.183064 Aug 05 15:37:02.590097 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 338/669] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:37:02 2022] DELETE /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:37:02.600488 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5ba761bd-4560-489f-ab3a-337452bfc64f tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14ef6ee0>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:02.650257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5ba761bd-4560-489f-ab3a-337452bfc64f tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c" status: 200 len: 344 microversion: 2.1 time: 0.054730 Aug 05 15:37:02.650822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 332/670] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:37:02 2022] GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:37:02.919103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:02.919747 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:02.925839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:02.926328 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:02.926770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:02.927461 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:02.927920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:02.928402 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:03.061479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:03.069030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b9d56925-a5f3-483c-bdf4-0c09443fcc85 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.154379 Aug 05 15:37:03.069592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 339/671] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:02 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:03.115338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:03.116137 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:03.122323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:03.122803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:03.123239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:03.123927 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:03.124408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:03.124833 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:03.259163 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:03.267045 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:03.268815 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:03.269951 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9f777c2f-6e35-4d3d-acb8-07ca7c18572d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.159218 Aug 05 15:37:03.270502 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 333/672] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:03 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:37:03.664196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef35e5ab-798c-4171-8af8-b9408eb0f8dc tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14ec5940>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:03.690941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-ef35e5ab-798c-4171-8af8-b9408eb0f8dc tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] HTTP exception thrown: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef35e5ab-798c-4171-8af8-b9408eb0f8dc tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Request method failure captured: Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c HTTP/1.1 Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TkWRu772gJjZQ5K5HCVe1WSt0XTLGt2MLzYBn0Fc3v-L6FxsGBp9-juNbafseELqhO9lWIhyCUOh-L1jO8DpIBaiudbvu4Yst23V0sX2a5pgMuXTIN_X1p7mBN4I_NoY7VaR4eUrgDT12-TgbdLSjzA0_PNWV_3dESVaWTqDL787w0 Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 5a1e917d8dfe4aee9d739d4df1b268fc Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:37:03.692884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a1e917d8dfe4aee9d739d4df1b268fc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a1e917d8dfe4aee9d739d4df1b268fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a1e917d8dfe4aee9d739d4df1b268fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a1e917d8dfe4aee9d739d4df1b268fc"}]}] Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 5a1e917d8dfe4aee9d739d4df1b268fc Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-VolumesSnapshotsTestJSON-1031681263-project Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 561df7f148964b27978333ef1422b9bf Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1031681263-project Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '14cb9a92-5d5b-47f0-a0fc-54893382981c'} Aug 05 15:37:03.694427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. (HTTP 404) (Request-ID: req-ea4be7af-6839-4ae8-ba97-b93aa4754097) Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.695377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:37:03.697195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 15:37:03.698508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef35e5ab-798c-4171-8af8-b9408eb0f8dc tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Returning 404 to user: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ef35e5ab-798c-4171-8af8-b9408eb0f8dc tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c" status: 404 len: 109 microversion: 2.1 time: 0.034007 Aug 05 15:37:03.699818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 340/673] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:37:03 2022] GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:37:03.708740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6ad8eabd-d4d5-4656-938e-a17f9fedaa4e tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d6aa60>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:03.736008 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-6ad8eabd-d4d5-4656-938e-a17f9fedaa4e tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] HTTP exception thrown: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6ad8eabd-d4d5-4656-938e-a17f9fedaa4e tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Request method failure captured: Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: DELETE /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c HTTP/1.1 Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TkWRu772gJjZQ5K5HCVe1WSt0XTLGt2MLzYBn0Fc3v-L6FxsGBp9-juNbafseELqhO9lWIhyCUOh-L1jO8DpIBaiudbvu4Yst23V0sX2a5pgMuXTIN_X1p7mBN4I_NoY7VaR4eUrgDT12-TgbdLSjzA0_PNWV_3dESVaWTqDL787w0 Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 5a1e917d8dfe4aee9d739d4df1b268fc Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:37:03.738132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a1e917d8dfe4aee9d739d4df1b268fc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a1e917d8dfe4aee9d739d4df1b268fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a1e917d8dfe4aee9d739d4df1b268fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a1e917d8dfe4aee9d739d4df1b268fc"}]}] Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 5a1e917d8dfe4aee9d739d4df1b268fc Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-VolumesSnapshotsTestJSON-1031681263-project Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 561df7f148964b27978333ef1422b9bf Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1031681263-project Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '14cb9a92-5d5b-47f0-a0fc-54893382981c'} Aug 05 15:37:03.739583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. (HTTP 404) (Request-ID: req-155dace3-73ec-4b2d-b0af-f12fe36fa13a) Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.740554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 15:37:03.741929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 15:37:03.743190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6ad8eabd-d4d5-4656-938e-a17f9fedaa4e tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Returning 404 to user: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-6ad8eabd-d4d5-4656-938e-a17f9fedaa4e tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c" status: 404 len: 109 microversion: 2.1 time: 0.034531 Aug 05 15:37:03.745030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 334/674] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:37:03 2022] DELETE /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:37:03.748483 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0f9874bb-10b4-4636-a4de-6edf215fa944 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Calling method '.version_select at 0x7fcb14d69ca0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:03.776117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-0f9874bb-10b4-4636-a4de-6edf215fa944 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] HTTP exception thrown: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0f9874bb-10b4-4636-a4de-6edf215fa944 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Request method failure captured: Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c HTTP/1.1 Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TkWRu772gJjZQ5K5HCVe1WSt0XTLGt2MLzYBn0Fc3v-L6FxsGBp9-juNbafseELqhO9lWIhyCUOh-L1jO8DpIBaiudbvu4Yst23V0sX2a5pgMuXTIN_X1p7mBN4I_NoY7VaR4eUrgDT12-TgbdLSjzA0_PNWV_3dESVaWTqDL787w0 Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 5a1e917d8dfe4aee9d739d4df1b268fc Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:37:03.778020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a1e917d8dfe4aee9d739d4df1b268fc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a1e917d8dfe4aee9d739d4df1b268fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a1e917d8dfe4aee9d739d4df1b268fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a1e917d8dfe4aee9d739d4df1b268fc"}]}] Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 5a1e917d8dfe4aee9d739d4df1b268fc Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1031681263 Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-VolumesSnapshotsTestJSON-1031681263-project Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 561df7f148964b27978333ef1422b9bf Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1031681263-project Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '14cb9a92-5d5b-47f0-a0fc-54893382981c'} Aug 05 15:37:03.779490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. (HTTP 404) (Request-ID: req-112759c1-ed94-493f-864a-19d45b36a435) Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.780424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 15:37:03.781724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 15:37:03.783033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0f9874bb-10b4-4636-a4de-6edf215fa944 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] Returning 404 to user: Volume 14cb9a92-5d5b-47f0-a0fc-54893382981c could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0f9874bb-10b4-4636-a4de-6edf215fa944 tempest-VolumesSnapshotsTestJSON-1031681263 tempest-VolumesSnapshotsTestJSON-1031681263-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c" status: 404 len: 109 microversion: 2.1 time: 0.034617 Aug 05 15:37:03.784345 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 341/675] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 15:37:03 2022] GET /compute/v2.1/os-volumes/14cb9a92-5d5b-47f0-a0fc-54893382981c => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:37:04.089718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:04.090356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:04.097491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:04.098027 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:04.098400 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:04.099098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:04.099551 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:04.100025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:04.255069 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:04.266034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-214af43b-17f5-4aaf-a721-bc579008b016 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.180215 Aug 05 15:37:04.266740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 335/676] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:04 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:04.294154 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:04.294905 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:04.300871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:04.301511 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:04.301797 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:04.302668 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:04.303127 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:04.303544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:04.443777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:04.452556 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:04.455151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:04.455151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b7f19918-cf7e-441e-8153-eda8967402c6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1729 microversion: 2.20 time: 0.166011 Aug 05 15:37:04.455710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 342/677] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:04 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 15:37:04.482384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-c2938819-26cc-4b9d-ac3a-d18954f92b9b req-17577d3a-ad9c-40ed-b66e-a23d53c23918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d625ed-7eae-4709-807a-e8f31d867223", "name": "network-vif-plugged", "status": "completed", "tag": "ac766b47-3986-4402-a256-ed26abd4fa9c"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:37:04.485536 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c2938819-26cc-4b9d-ac3a-d18954f92b9b req-17577d3a-ad9c-40ed-b66e-a23d53c23918 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:04.486010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c2938819-26cc-4b9d-ac3a-d18954f92b9b req-17577d3a-ad9c-40ed-b66e-a23d53c23918 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:04.486428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c2938819-26cc-4b9d-ac3a-d18954f92b9b req-17577d3a-ad9c-40ed-b66e-a23d53c23918 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:04.497858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-c2938819-26cc-4b9d-ac3a-d18954f92b9b req-17577d3a-ad9c-40ed-b66e-a23d53c23918 service nova] Creating event network-vif-plugged:ac766b47-3986-4402-a256-ed26abd4fa9c for instance 09d625ed-7eae-4709-807a-e8f31d867223 on hv-cinder-84989 Aug 05 15:37:04.502598 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-c2938819-26cc-4b9d-ac3a-d18954f92b9b req-17577d3a-ad9c-40ed-b66e-a23d53c23918 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030386 Aug 05 15:37:04.503748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 336/678] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:37:05.288207 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:05.288796 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:05.295777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:05.296407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:05.296719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:05.297419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:05.297918 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:05.298301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:05.429013 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:05.436599 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-92788aaf-42f2-44ff-a1e2-d177918b5bba tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.152406 Aug 05 15:37:05.439958 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 343/679] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:05 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:05.480469 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:05.485737 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:05.487455 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:05.487934 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:05.488396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:05.489082 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:05.489591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:05.489946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:05.621410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:05.630031 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:05.631514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:05.632762 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-32120986-e015-42b0-b091-fe15be2de97d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1716 microversion: 2.20 time: 0.157722 Aug 05 15:37:05.634554 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 337/680] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:05 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:37:06.458891 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:06.460248 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:06.466626 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:06.467148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:06.467576 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:06.468291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:06.468745 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:06.477717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:06.618300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:06.627296 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-16cd7be3-ee2a-44d2-acd8-9192db02f1dc tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1313 microversion: 2.1 time: 0.172425 Aug 05 15:37:06.627852 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 344/681] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:06 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:07.652248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:07.652782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:07.659105 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:07.659583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:07.660010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:07.660720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:07.661167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:07.661586 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:07.789860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:07.797262 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e0b93507-fdbb-40fc-832a-39c7456477e0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1498 microversion: 2.1 time: 0.149055 Aug 05 15:37:07.797814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 338/682] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:07 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:08.511042 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:08.511528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:08.517924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:08.518501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:08.519119 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:08.519813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:08.520300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:08.520731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:08.548270 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Going to try to terminate instance {{(pid=118723) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:37:08.846775 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-dff12112-4be9-41a9-b633-5c18cd18b860 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "DELETE /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 204 len: 0 microversion: 2.1 time: 0.339398 Aug 05 15:37:08.847364 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 345/683] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:37:08 2022] DELETE /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:37:08.855570 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:08.856229 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:08.862523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:08.862993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:08.863417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:08.869123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:08.869123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:08.869123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:09.240395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:09.248364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-6c6daf7d-6ae3-48f3-b1da-947e7d561f23 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1504 microversion: 2.1 time: 0.396583 Aug 05 15:37:09.248923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 339/684] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:08 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:10.270617 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:10.271349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:10.278357 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:10.278836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:10.279270 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:10.279952 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:10.280437 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:10.280863 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:10.407267 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:10.414645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0c9f935a-1809-482d-9ef7-32f81383f7a7 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1504 microversion: 2.1 time: 0.148476 Aug 05 15:37:10.415214 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 346/685] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:10 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:11.434764 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:11.435341 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:11.441941 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:11.442414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:11.442838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:11.443520 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:11.443960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:11.444401 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:11.571937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:11.579181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-23b3c734-3e63-4982-a835-ef62aa8343f0 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1504 microversion: 2.1 time: 0.148268 Aug 05 15:37:11.579734 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 340/686] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:11 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:12.600556 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:12.601380 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:12.608794 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:12.609291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:12.609730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:12.610488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:12.610954 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:12.611520 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:12.627815 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:37:12.710501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:12.725012 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-b01e39f3-0901-4484-a4bf-fa869b770d24 req-aa2b359f-d79c-442e-bd3e-6150a03a0084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d625ed-7eae-4709-807a-e8f31d867223", "name": "network-vif-deleted", "tag": "ac766b47-3986-4402-a256-ed26abd4fa9c"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:37:12.726280 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c29c5d35-2651-47ee-b359-a117bb8b1082 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1462 microversion: 2.1 time: 0.128743 Aug 05 15:37:12.726890 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 347/687] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:12 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1462 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:12.735583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b01e39f3-0901-4484-a4bf-fa869b770d24 req-aa2b359f-d79c-442e-bd3e-6150a03a0084 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:12.742849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b01e39f3-0901-4484-a4bf-fa869b770d24 req-aa2b359f-d79c-442e-bd3e-6150a03a0084 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:12.742849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b01e39f3-0901-4484-a4bf-fa869b770d24 req-aa2b359f-d79c-442e-bd3e-6150a03a0084 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:12.747260 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-b01e39f3-0901-4484-a4bf-fa869b770d24 req-aa2b359f-d79c-442e-bd3e-6150a03a0084 service nova] Creating event network-vif-deleted:ac766b47-3986-4402-a256-ed26abd4fa9c for instance 09d625ed-7eae-4709-807a-e8f31d867223 on hv-cinder-84989 Aug 05 15:37:12.752017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-b01e39f3-0901-4484-a4bf-fa869b770d24 req-aa2b359f-d79c-442e-bd3e-6150a03a0084 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030877 Aug 05 15:37:12.752866 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 341/688] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:37:13.749118 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:13.749646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:13.756336 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:13.756813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:13.757248 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:13.757933 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:13.758388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:13.758810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:13.788739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:13.789211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:13.789645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:13.790086 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lazy-loading 'fault' on Instance uuid 09d625ed-7eae-4709-807a-e8f31d867223 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:37:13.833662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:13.840918 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-16ba69c9-0ef2-42a1-974d-88005070a43d tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1303 microversion: 2.1 time: 0.095696 Aug 05 15:37:13.841478 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 348/689] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:13 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:14.863403 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:14.864110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:14.870352 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:14.870841 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:14.871281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:14.871972 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:14.872462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:14.872894 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:14.903718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:14.904218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:14.904654 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:14.905103 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lazy-loading 'fault' on Instance uuid 09d625ed-7eae-4709-807a-e8f31d867223 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:37:14.945807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:14.953843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-691ca4c1-b720-406e-81b4-aa42a9af89ab tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1303 microversion: 2.1 time: 0.095110 Aug 05 15:37:14.954421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 342/690] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:14 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:15.975229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:15.975843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:15.982981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:15.983467 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:15.983904 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:15.984628 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:15.985108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:15.985513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:16.016177 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:16.016663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:16.017099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:16.017547 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lazy-loading 'fault' on Instance uuid 09d625ed-7eae-4709-807a-e8f31d867223 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:37:16.060165 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff040e1f99bf46d48446e2e9c0deb9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd370ebabf4f048e72f7b1fbadcb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:16.067671 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9bf38c14-8c52-453f-9d20-e0637450d5f5 tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 200 len: 1303 microversion: 2.1 time: 0.096300 Aug 05 15:37:16.068259 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 349/691] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:15 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:17.088873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:17.089658 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] [instance: 09d625ed-7eae-4709-807a-e8f31d867223] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:17.096230 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:17.096713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:17.097147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:17.097867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:17.098321 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:17.098740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:17.112920 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] HTTP exception thrown: Instance 09d625ed-7eae-4709-807a-e8f31d867223 could not be found. Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Request method failure captured: Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 HTTP/1.1 Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TjvmpGK-G7ngmsWWlCfz7DNSlcCnokZgr_NgZeXspmZV-DINtrRHNu9n7rsmMwtJ0-TFkR9iDlboIjgdBFf6BwQPG-jfCJUDxvbsevR5CZ6DM6mBzaWcTh1D_K3iVIyDxpcGeqrh23WJvf4s6epMxSeAQcHqE5Ti3ojrKy9vsUeV4E Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 07cd370ebabf4f048e72f7b1fbadcb08 Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-VolumesActionsTest-1080612332 Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:37:17.114576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07cd370ebabf4f048e72f7b1fbadcb08", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07cd370ebabf4f048e72f7b1fbadcb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07cd370ebabf4f048e72f7b1fbadcb08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07cd370ebabf4f048e72f7b1fbadcb08"}]}] Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-VolumesActionsTest-1080612332 Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 07cd370ebabf4f048e72f7b1fbadcb08 Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-VolumesActionsTest-1080612332 Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-VolumesActionsTest-1080612332-project Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: ff040e1f99bf46d48446e2e9c0deb9cc Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-VolumesActionsTest-1080612332-project Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 09d625ed-7eae-4709-807a-e8f31d867223 could not be found. Aug 05 15:37:17.116141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '09d625ed-7eae-4709-807a-e8f31d867223'} Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d625ed-7eae-4709-807a-e8f31d867223 could not be found. Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:17.119946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d625ed-7eae-4709-807a-e8f31d867223 could not be found. Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d625ed-7eae-4709-807a-e8f31d867223 could not be found. Aug 05 15:37:17.122098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:17.123487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] Returning 404 to user: Instance 09d625ed-7eae-4709-807a-e8f31d867223 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:17.123487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d9ea87ae-5cf5-4216-bf9b-78e34cd7568e tempest-VolumesActionsTest-1080612332 tempest-VolumesActionsTest-1080612332-project] 10.222.0.40 "GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223" status: 404 len: 111 microversion: 2.1 time: 0.030978 Aug 05 15:37:17.123487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 343/692] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:37:17 2022] GET /compute/v2.1/servers/09d625ed-7eae-4709-807a-e8f31d867223 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:37:47.643126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:47.646759 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:47.650037 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:37:47.650675 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=19 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:37:47.654800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:47.655282 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:47.656392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:47.657096 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:47.657629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:47.658053 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:47.698034 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9c6a609f-1617-466c-878e-17d48297b89d tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058949 Aug 05 15:37:47.699121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 350/693] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 5 15:37:47 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:37:47.781130 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:47.781689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:47.783746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=24 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:37:47.784403 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=98 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:37:47.789073 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:47.789547 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:47.789975 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:47.790660 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:47.791108 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:47.791523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:47.816316 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:37:48.093929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-57b6fc9f-d837-4795-9f5d-d049d56398e4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 204 len: 0 microversion: 2.20 time: 0.317048 Aug 05 15:37:48.094376 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 344/694] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 5 15:37:47 2022] DELETE /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 15:37:48.107295 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:48.107926 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:48.114705 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:48.115184 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:48.115613 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:48.116328 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:48.116783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:48.117207 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:48.256627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:48.265020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:48.266532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:48.267696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b112a03c-0b8d-4dd7-8546-bb46ecb323aa tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.164838 Aug 05 15:37:48.268261 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 351/695] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:48 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:37:49.291312 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:49.294687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:49.298476 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:49.298948 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:49.299374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:49.300058 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:49.300541 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:49.301074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:49.436942 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:49.445044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:49.449734 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:49.449734 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-177aebc9-d456-4fae-a205-5459de8ab9a6 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1722 microversion: 2.20 time: 0.160663 Aug 05 15:37:49.449734 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 345/696] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:49 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:37:50.471305 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:50.472164 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:50.481008 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:50.481629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:50.482119 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:50.482888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:50.483964 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:50.484674 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:50.511378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-0eda0e4c-8d6d-48a9-8e97-49da8ccd4786 req-4c54adde-ff71-41b2-ae4c-9ac09130d8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a10dbd4-0580-46dc-821e-98476c654d5a", "name": "network-vif-deleted", "tag": "b7a39fee-4688-4052-adea-986dac23d796"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:37:50.523038 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-0eda0e4c-8d6d-48a9-8e97-49da8ccd4786 req-4c54adde-ff71-41b2-ae4c-9ac09130d8aa service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:50.523584 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-0eda0e4c-8d6d-48a9-8e97-49da8ccd4786 req-4c54adde-ff71-41b2-ae4c-9ac09130d8aa service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:50.525139 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-0eda0e4c-8d6d-48a9-8e97-49da8ccd4786 req-4c54adde-ff71-41b2-ae4c-9ac09130d8aa service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:50.563016 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-0eda0e4c-8d6d-48a9-8e97-49da8ccd4786 req-4c54adde-ff71-41b2-ae4c-9ac09130d8aa service nova] Creating event network-vif-deleted:b7a39fee-4688-4052-adea-986dac23d796 for instance 8a10dbd4-0580-46dc-821e-98476c654d5a on hv-cinder-84989 Aug 05 15:37:50.578657 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-0eda0e4c-8d6d-48a9-8e97-49da8ccd4786 req-4c54adde-ff71-41b2-ae4c-9ac09130d8aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070981 Aug 05 15:37:50.581577 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 346/697] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:37:50.602969 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:50.611918 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:50.613470 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd36b38a6e2d34c41b827ff6db9742332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648f7ac8fb934441b6782d00d0b5ef10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:37:50.614698 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f0ffd543-c0f8-4eb6-ae20-9bb338cd31d2 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 200 len: 1655 microversion: 2.20 time: 0.147671 Aug 05 15:37:50.615302 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 352/698] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:50 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 15:37:51.639773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:51.640497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:51.646885 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:51.647302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:51.647731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:51.648435 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:51.648878 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:51.649388 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:51.663173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] HTTP exception thrown: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Request method failure captured: Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a HTTP/1.1 Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te-Eaah6-vbJaoP3c-qKWtztwg6AT1xr6i3V75WXkkP0vWwEB_9fbgKBqy0Dz_YbisLLht6fk2CSnwe6ZdaYFcmUtR53apoJaMoIPCk9tetVNHSqu4ySe_skgl-UXmeivrmHM_0df1CdvLZhTUN75Yyn9WNore-ERWu60iSefre9Ko Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:37:51.664884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_648f7ac8fb934441b6782d00d0b5ef10", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/648f7ac8fb934441b6782d00d0b5ef10"}]}] Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: d36b38a6e2d34c41b827ff6db9742332 Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:51.666555 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '8a10dbd4-0580-46dc-821e-98476c654d5a'} Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:51.667418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:51.669427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:51.671425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Returning 404 to user: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:51.671425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-793e5cd9-7bc9-47a3-af82-f5f0d831aa90 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 404 len: 111 microversion: 2.20 time: 0.031178 Aug 05 15:37:51.671425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 347/699] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:51 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:37:51.677385 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f9251dc0-12d4-416a-bebe-9eebdfd50fce tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '.version_select at 0x7fcb14d7adc0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:51.770175 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f9251dc0-12d4-416a-bebe-9eebdfd50fce tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-902446733" status: 204 len: 0 microversion: 2.20 time: 0.096879 Aug 05 15:37:51.771083 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 353/700] 10.222.0.40 () {60 vars in 1259 bytes} [Fri Aug 5 15:37:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-902446733 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 15:37:53.794909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:53.796407 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:53.802692 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:53.803220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:53.803669 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:53.804391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:53.804848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:53.805271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:53.819550 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] HTTP exception thrown: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Request method failure captured: Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: DELETE /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a HTTP/1.1 Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te-Eaah6-vbJaoP3c-qKWtztwg6AT1xr6i3V75WXkkP0vWwEB_9fbgKBqy0Dz_YbisLLht6fk2CSnwe6ZdaYFcmUtR53apoJaMoIPCk9tetVNHSqu4ySe_skgl-UXmeivrmHM_0df1CdvLZhTUN75Yyn9WNore-ERWu60iSefre9Ko Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:37:53.821138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_648f7ac8fb934441b6782d00d0b5ef10", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/648f7ac8fb934441b6782d00d0b5ef10"}]}] Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: d36b38a6e2d34c41b827ff6db9742332 Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.822763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '8a10dbd4-0580-46dc-821e-98476c654d5a'} Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:53.823553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.824873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.826052 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Returning 404 to user: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:53.826052 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-6031c1ca-325a-4d3c-aecc-a53d38db8229 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 404 len: 111 microversion: 2.20 time: 0.031557 Aug 05 15:37:53.826052 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 348/701] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 5 15:37:53 2022] DELETE /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:37:53.831763 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:53.832406 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: 8a10dbd4-0580-46dc-821e-98476c654d5a] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:53.838883 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:53.839363 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:53.842002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:53.842002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:53.842002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:53.842002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:53.854135 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] HTTP exception thrown: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Request method failure captured: Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a HTTP/1.1 Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7Te-Eaah6-vbJaoP3c-qKWtztwg6AT1xr6i3V75WXkkP0vWwEB_9fbgKBqy0Dz_YbisLLht6fk2CSnwe6ZdaYFcmUtR53apoJaMoIPCk9tetVNHSqu4ySe_skgl-UXmeivrmHM_0df1CdvLZhTUN75Yyn9WNore-ERWu60iSefre9Ko Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:37:53.855749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_648f7ac8fb934441b6782d00d0b5ef10", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/648f7ac8fb934441b6782d00d0b5ef10"}]}] Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: d36b38a6e2d34c41b827ff6db9742332 Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.857505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '8a10dbd4-0580-46dc-821e-98476c654d5a'} Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:53.858875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. Aug 05 15:37:53.860321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:53.861562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Returning 404 to user: Instance 8a10dbd4-0580-46dc-821e-98476c654d5a could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:53.861562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1f9c6fac-fed2-4596-bc51-9c5c57ebabe8 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a" status: 404 len: 111 microversion: 2.20 time: 0.029718 Aug 05 15:37:53.861562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 354/702] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:53 2022] GET /compute/v2.1/servers/8a10dbd4-0580-46dc-821e-98476c654d5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:37:55.100535 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:55.101065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:55.107563 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:55.109281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:55.109281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:55.109701 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:55.110157 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:55.110586 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:55.125076 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] HTTP exception thrown: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Request method failure captured: Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: DELETE /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d HTTP/1.1 Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7Te-Eaah6-vbJaoP3c-qKWtztwg6AT1xr6i3V75WXkkP0vWwEB_9fbgKBqy0Dz_YbisLLht6fk2CSnwe6ZdaYFcmUtR53apoJaMoIPCk9tetVNHSqu4ySe_skgl-UXmeivrmHM_0df1CdvLZhTUN75Yyn9WNore-ERWu60iSefre9Ko Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:37:55.126998 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_648f7ac8fb934441b6782d00d0b5ef10", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/648f7ac8fb934441b6782d00d0b5ef10"}]}] Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: d36b38a6e2d34c41b827ff6db9742332 Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.128759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'c377a731-4e6f-47c0-96f5-1b3e2237897d'} Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:55.130259 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.132161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.134199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Returning 404 to user: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:55.134199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-77fa81e4-9e27-4248-ba84-6bf73ec2bec4 tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 404 len: 111 microversion: 2.20 time: 0.031830 Aug 05 15:37:55.134199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 349/703] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 5 15:37:55 2022] DELETE /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:37:55.136874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:37:55.137544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] [instance: c377a731-4e6f-47c0-96f5-1b3e2237897d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:37:55.147706 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:55.147706 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:55.147706 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:55.147706 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:37:55.148113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:37:55.148113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:37:55.160765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] HTTP exception thrown: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Request method failure captured: Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d HTTP/1.1 Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7Te-Eaah6-vbJaoP3c-qKWtztwg6AT1xr6i3V75WXkkP0vWwEB_9fbgKBqy0Dz_YbisLLht6fk2CSnwe6ZdaYFcmUtR53apoJaMoIPCk9tetVNHSqu4ySe_skgl-UXmeivrmHM_0df1CdvLZhTUN75Yyn9WNore-ERWu60iSefre9Ko Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:37:55.162276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_648f7ac8fb934441b6782d00d0b5ef10", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/648f7ac8fb934441b6782d00d0b5ef10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/648f7ac8fb934441b6782d00d0b5ef10"}]}] Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 648f7ac8fb934441b6782d00d0b5ef10 Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-382133502 Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: d36b38a6e2d34c41b827ff6db9742332 Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-382133502-project Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.163843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': 'c377a731-4e6f-47c0-96f5-1b3e2237897d'} Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:37:55.164620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. Aug 05 15:37:55.165800 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:37:55.166981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] Returning 404 to user: Instance c377a731-4e6f-47c0-96f5-1b3e2237897d could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:37:55.166981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-58814dd9-2d68-46ab-b970-0de7b1ceacbc tempest-AttachVolumeShelveTestJSON-382133502 tempest-AttachVolumeShelveTestJSON-382133502-project] 10.222.0.40 "GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d" status: 404 len: 111 microversion: 2.20 time: 0.031050 Aug 05 15:37:55.166981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 355/704] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 15:37:55 2022] GET /compute/v2.1/servers/c377a731-4e6f-47c0-96f5-1b3e2237897d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 15:38:06.589015 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:06.589888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:06.725933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-bea18731-db00-44c9-a408-4f9f47a15a17 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: .version_select at 0x7fcb14d1d940>, body: {"keypair": {"name": "tempest-keypair-640941642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzOn0juQSAfrX87Zbo3URBFXCZX5YsfGgH+VDFR+GXkJYhSNdQtpMOSpYsbikDwemZMkygD0l3y5u7JTZsFeChnQzstmD10LyPomGrKgulRwXbNKa2fkY9+QXc6PRIrow=="}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:06.761808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-bea18731-db00-44c9-a408-4f9f47a15a17 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for project 2c77da48edba4903a1c51fee2a856167. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:38:06.769863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-bea18731-db00-44c9-a408-4f9f47a15a17 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for user dd5c43d63a754eeaaba429f5c8153bba and project 2c77da48edba4903a1c51fee2a856167. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:38:06.884872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-bea18731-db00-44c9-a408-4f9f47a15a17 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.301318 Aug 05 15:38:06.885466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 350/705] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:38:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:09.459461 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-397683720", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b05605aa-dd0e-428b-8865-2528537f12f7"}], "security_groups": [{"name": "tempest-securitygroup--684138362"}], "key_name": "tempest-keypair-640941642", "user_data": "}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:09.469604 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:09.470492 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=22 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:09.591096 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] validate_networks() for [('b05605aa-dd0e-428b-8865-2528537f12f7', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:38:10.033220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:38:10.033651 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:38:10.034368 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:38:10.034787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:38:10.035207 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:38:10.044119 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:10.044912 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:10.045583 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:10.047309 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:10.048246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:10.050864 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:10.071928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for project 2c77da48edba4903a1c51fee2a856167. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:38:10.077588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for user dd5c43d63a754eeaaba429f5c8153bba and project 2c77da48edba4903a1c51fee2a856167. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:38:10.090040 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:38:10.092882 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:38:10.212810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-937413a9-a56b-4e73-9b11-d673a3417885 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.757666 Aug 05 15:38:10.213678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 356/706] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:38:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:38:10.226174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9926ea33-df63-41bf-a144-12b820562d23 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:10.226792 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9926ea33-df63-41bf-a144-12b820562d23 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:10.292822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9926ea33-df63-41bf-a144-12b820562d23 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:10.304701 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9926ea33-df63-41bf-a144-12b820562d23 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1240 microversion: 2.1 time: 0.083255 Aug 05 15:38:10.305272 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 351/707] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:10 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:11.331507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:11.332262 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:11.339954 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:11.340564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:11.341080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:11.341792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:11.342261 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:11.342734 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:11.410553 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:11.418198 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d7e83e81-c084-4dfe-8fef-9cb1e73e245f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1244 microversion: 2.1 time: 0.091173 Aug 05 15:38:11.418978 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 357/708] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:11 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:12.443920 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:12.445000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:12.456772 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:12.457653 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:12.458414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:12.459657 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:12.460599 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:12.461390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:12.558170 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:12.566385 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-aacce6b4-d3ee-43c4-ab7f-0191bbdb3568 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1300 microversion: 2.1 time: 0.131014 Aug 05 15:38:12.569737 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 352/709] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:12 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1300 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:13.586867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:13.587557 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:13.594179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:13.594658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:13.595090 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:13.595774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:13.596282 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:13.596704 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:13.807916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:13.816336 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-92d341d5-3dd5-4674-b140-77e489181906 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1365 microversion: 2.1 time: 0.233346 Aug 05 15:38:13.816903 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 358/710] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:13 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:14.430682 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-d5a2db67-c56c-4ba0-8659-68228c77c296 req-f71938bc-c32e-4c1b-b23c-5e5925c6f5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f435a35-7760-4b03-8d2e-6f40df5f5714", "tag": "fe6362dc-a493-493c-b74d-993dbc8bfad2"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:14.440918 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-d5a2db67-c56c-4ba0-8659-68228c77c296 req-f71938bc-c32e-4c1b-b23c-5e5925c6f5ac service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:14.441487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-d5a2db67-c56c-4ba0-8659-68228c77c296 req-f71938bc-c32e-4c1b-b23c-5e5925c6f5ac service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:14.441973 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-d5a2db67-c56c-4ba0-8659-68228c77c296 req-f71938bc-c32e-4c1b-b23c-5e5925c6f5ac service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:14.453514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-d5a2db67-c56c-4ba0-8659-68228c77c296 req-f71938bc-c32e-4c1b-b23c-5e5925c6f5ac service nova] Creating event network-changed:fe6362dc-a493-493c-b74d-993dbc8bfad2 for instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 on hv-cinder-84989 Aug 05 15:38:14.458440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-d5a2db67-c56c-4ba0-8659-68228c77c296 req-f71938bc-c32e-4c1b-b23c-5e5925c6f5ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031520 Aug 05 15:38:14.459578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 353/711] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:14.845580 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:14.846174 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:14.852664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:14.853153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:14.853590 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:14.854288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:14.854743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:14.855170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:15.077624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:15.085006 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-12bdcd0a-90f5-4a9a-8af3-0cd9fe867803 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1365 microversion: 2.1 time: 0.243342 Aug 05 15:38:15.085567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 359/712] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:14 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:16.107237 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:16.107920 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:16.114970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:16.115540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:16.115966 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:16.116843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:16.117580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:16.118039 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:16.256713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:16.264240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-674a1076-6ae8-439b-b1c2-da0fb08285a7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1365 microversion: 2.1 time: 0.161538 Aug 05 15:38:16.264810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 354/713] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:16 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:17.286743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:17.288044 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:17.295398 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:17.295952 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:17.297125 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:17.297838 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:17.298293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:17.298718 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:17.441369 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:17.450002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-007f8e0d-8d34-41af-ad55-39d8710fca2d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1365 microversion: 2.1 time: 0.167287 Aug 05 15:38:17.450878 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 360/714] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:17 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:18.471228 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:18.472285 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:18.479194 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:18.479709 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:18.480176 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:18.480874 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:18.481395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:18.481846 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:18.624930 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:18.636805 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-39bc3813-da87-4c74-b7dc-2ed842cbbaec tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1365 microversion: 2.1 time: 0.169658 Aug 05 15:38:18.637677 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 355/715] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:18 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:19.660108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:19.660624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:19.667740 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:19.668697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:19.669524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:19.670381 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:19.670856 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:19.672021 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:19.812108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:19.819487 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1df6403f-e58b-4e03-9f08-e2e1e6072191 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1365 microversion: 2.1 time: 0.164078 Aug 05 15:38:19.820060 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 361/716] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:19 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:20.328035 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-bcd673d4-effc-4213-a249-e8c7f7c936d6 req-76a81db7-16ff-4d7a-abe7-ea68712b91a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f435a35-7760-4b03-8d2e-6f40df5f5714", "name": "network-vif-plugged", "status": "completed", "tag": "fe6362dc-a493-493c-b74d-993dbc8bfad2"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:20.336527 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=6 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:20.339165 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-bcd673d4-effc-4213-a249-e8c7f7c936d6 req-76a81db7-16ff-4d7a-abe7-ea68712b91a2 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:20.339363 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-bcd673d4-effc-4213-a249-e8c7f7c936d6 req-76a81db7-16ff-4d7a-abe7-ea68712b91a2 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:20.339977 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-bcd673d4-effc-4213-a249-e8c7f7c936d6 req-76a81db7-16ff-4d7a-abe7-ea68712b91a2 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:20.352901 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-bcd673d4-effc-4213-a249-e8c7f7c936d6 req-76a81db7-16ff-4d7a-abe7-ea68712b91a2 service nova] Creating event network-vif-plugged:fe6362dc-a493-493c-b74d-993dbc8bfad2 for instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 on hv-cinder-84989 Aug 05 15:38:20.358136 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-bcd673d4-effc-4213-a249-e8c7f7c936d6 req-76a81db7-16ff-4d7a-abe7-ea68712b91a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Aug 05 15:38:20.359897 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 356/717] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:20.419389 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1549908003", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:20.428749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:20.429139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=6 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:20.473373 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] validate_networks() for None {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:38:20.806116 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:38:20.806677 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:38:20.807330 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:38:20.807836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:38:20.808293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:38:20.817458 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:20.817937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:20.818367 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:20.819126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:20.824880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:20.824880 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:20.837105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Getting quotas for project acd3963551a44ea8a6f9f5829f7d2332. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:38:20.840644 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:20.840838 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Getting quotas for user 22f4a016c52647db95dfdd2c29c7bec3 and project acd3963551a44ea8a6f9f5829f7d2332. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:38:20.841381 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:20.848334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:20.848819 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:20.849253 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:20.849956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:20.850413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:20.850840 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:20.852622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:38:20.854724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:38:20.988088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-640704c1-baad-440d-8517-d7e98e092a44 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572576 Aug 05 15:38:20.988712 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 362/718] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:38:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:38:20.998653 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:21.000244 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9e919c22-712d-44f7-bd8c-39eb2e8af702 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:21.001036 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9e919c22-712d-44f7-bd8c-39eb2e8af702 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:21.006250 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-599d1a5f-ddec-4e74-b362-ca76bb4a776f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1365 microversion: 2.1 time: 0.170089 Aug 05 15:38:21.007196 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 357/719] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:20 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:21.062080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9e919c22-712d-44f7-bd8c-39eb2e8af702 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:21.070615 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9e919c22-712d-44f7-bd8c-39eb2e8af702 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1215 microversion: 2.1 time: 0.074409 Aug 05 15:38:21.071182 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 363/720] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:20 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:22.033684 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:22.034302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:22.040590 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:22.041061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:22.041496 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:22.042186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:22.042639 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:22.043064 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:22.091479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:22.092787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:22.099859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:22.100392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:22.100840 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:22.101554 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:22.102020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:22.102459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:22.196626 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:22.204838 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0edc1005-8382-46d8-94ff-024aad7a01a5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1219 microversion: 2.1 time: 0.117290 Aug 05 15:38:22.205676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 364/721] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:22 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:22.210313 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:22.217966 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-13fbe089-9a19-4294-a1d5-509c767ed5a8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1365 microversion: 2.1 time: 0.188216 Aug 05 15:38:22.218742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 358/722] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:22 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:23.225258 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:23.225866 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:23.232216 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:23.232703 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:23.233139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:23.233929 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:23.234383 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:23.234812 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:23.240002 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:23.240704 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:23.247007 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:23.247553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:23.248051 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:23.248758 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:23.249202 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:23.249618 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:23.303639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:23.311026 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-299c2586-d3a3-4606-abf4-d4b5e33a86ff tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1267 microversion: 2.1 time: 0.089561 Aug 05 15:38:23.311594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 365/723] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:23 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:23.396378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:23.407774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9c17ea8f-3b20-4a77-872b-169cbaf9ee7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1556 microversion: 2.1 time: 0.171494 Aug 05 15:38:23.408368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 359/724] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:23 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:23.428619 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:23.429134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:23.435148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:23.435647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:23.436106 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:23.436835 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:23.437288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:23.437745 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:23.512277 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fef41f2f-0e47-4e0e-b6f2-ebb68dab337e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087347 Aug 05 15:38:23.512871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 366/725] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 15:38:23 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:24.333194 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:24.333798 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:24.340076 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:24.340560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:24.340990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:24.341670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:24.342134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:24.342540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:24.435822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:24.443186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-feffb9ef-625a-44fb-999c-81ba5167039d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1267 microversion: 2.1 time: 0.114402 Aug 05 15:38:24.443744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 360/726] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:24 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:24.502813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-564693bd-6e88-4640-89b4-ef1cc3904f96 req-8bd15bf6-f0a0-4501-a2a6-eefe03fbb9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f435a35-7760-4b03-8d2e-6f40df5f5714", "tag": "fe6362dc-a493-493c-b74d-993dbc8bfad2"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:24.512406 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-564693bd-6e88-4640-89b4-ef1cc3904f96 req-8bd15bf6-f0a0-4501-a2a6-eefe03fbb9b5 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:24.512963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-564693bd-6e88-4640-89b4-ef1cc3904f96 req-8bd15bf6-f0a0-4501-a2a6-eefe03fbb9b5 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:24.513463 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-564693bd-6e88-4640-89b4-ef1cc3904f96 req-8bd15bf6-f0a0-4501-a2a6-eefe03fbb9b5 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:24.525451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-564693bd-6e88-4640-89b4-ef1cc3904f96 req-8bd15bf6-f0a0-4501-a2a6-eefe03fbb9b5 service nova] Creating event network-changed:fe6362dc-a493-493c-b74d-993dbc8bfad2 for instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 on hv-cinder-84989 Aug 05 15:38:24.530565 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-564693bd-6e88-4640-89b4-ef1cc3904f96 req-8bd15bf6-f0a0-4501-a2a6-eefe03fbb9b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032011 Aug 05 15:38:24.531162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 367/727] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:25.464796 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:25.465405 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:25.471746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:25.472270 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:25.472706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:25.473394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:25.473844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:25.474266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:25.535757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:25.543456 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-707dd7a2-493a-4262-9e2a-d5bc7611eb31 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1267 microversion: 2.1 time: 0.082315 Aug 05 15:38:25.545751 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 361/728] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:25 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:26.565594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:26.566297 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:26.573045 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:26.573530 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:26.573968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:26.574670 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:26.575127 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:26.575554 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:26.652288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:26.660233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-189729c9-d8ad-4406-9dbb-6386a154b05d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1273 microversion: 2.1 time: 0.099303 Aug 05 15:38:26.660809 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 368/729] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:26 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:27.682457 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:27.683116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:27.690505 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:27.690984 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:27.691416 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:27.692124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:27.692571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:27.692991 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:27.833861 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:27.841788 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-189de4f3-392a-41d9-ba53-f6db52564cc6 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.163348 Aug 05 15:38:27.856087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 362/730] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:27 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:28.048869 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-5c4643b8-2fb8-428e-ad2b-198392bfaa60 req-c1af9c2a-6722-43e5-9adf-e57937f2bbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1249d2a6-8c0f-4e2d-96e8-a729292dff7d", "tag": "8ceb2c80-ad1b-48fb-9eac-c2e9ec5aae5d"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:28.061062 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-5c4643b8-2fb8-428e-ad2b-198392bfaa60 req-c1af9c2a-6722-43e5-9adf-e57937f2bbc7 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:28.061765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-5c4643b8-2fb8-428e-ad2b-198392bfaa60 req-c1af9c2a-6722-43e5-9adf-e57937f2bbc7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:28.062204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-5c4643b8-2fb8-428e-ad2b-198392bfaa60 req-c1af9c2a-6722-43e5-9adf-e57937f2bbc7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:28.077191 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-5c4643b8-2fb8-428e-ad2b-198392bfaa60 req-c1af9c2a-6722-43e5-9adf-e57937f2bbc7 service nova] Creating event network-changed:8ceb2c80-ad1b-48fb-9eac-c2e9ec5aae5d for instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d on hv-cinder-84989 Aug 05 15:38:28.096935 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-5c4643b8-2fb8-428e-ad2b-198392bfaa60 req-c1af9c2a-6722-43e5-9adf-e57937f2bbc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050615 Aug 05 15:38:28.100056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 369/731] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:28.864608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:28.865192 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:28.871507 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:28.871990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:28.872463 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:28.873156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:28.873613 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:28.874039 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:28.999001 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:29.006487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5dffc54d-edd5-44d4-85c4-72eaf690ba8a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.145799 Aug 05 15:38:29.007050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 363/732] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:28 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:30.028981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:30.029710 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:30.035806 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:30.036323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:30.036760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:30.037449 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:30.037904 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:30.038326 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:30.200899 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:30.202966 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-78ee31c0-fd7f-4ce9-a8ae-47140d9e5fd2 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.178922 Aug 05 15:38:30.204266 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 370/733] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:30 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:31.223640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:31.224331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:31.230745 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:31.231391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:31.231645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:31.232360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:31.232837 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:31.233263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:31.366468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:31.374541 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7b306b1a-9685-48d4-8731-7daf7f38f33a tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.154757 Aug 05 15:38:31.375103 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 364/734] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:31 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:31.411094 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-184468239", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1091585729", "security_groups": [{"name": "tempest-secgroup-smoke-1650709576"}], "block_device_mapping_v2": [{"uuid": "d9cd5b68-6d5f-41cd-8a16-68054764a5e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b73dcac-fd0b-490d-b366-7eddfd909984"}]}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:31.420389 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:31.421664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=8 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:31.528289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] validate_networks() for [('9b73dcac-fd0b-490d-b366-7eddfd909984', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:38:32.145444 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:38:32.145888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:38:32.146360 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:38:32.146767 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:38:32.147178 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:38:32.156584 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:32.157737 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:32.158168 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:32.158910 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:32.159362 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:32.159785 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:32.177215 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Getting quotas for project 99b26247f85d45c0a7c1e763758f2e69. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:38:32.181187 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Getting quotas for user 1782b4e84c9f484297e17c248738105c and project 99b26247f85d45c0a7c1e763758f2e69. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:38:32.238750 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:38:32.240987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9cd5b68-6d5f-41cd-8a16-68054764a5e0',volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:38:32.396624 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:32.397209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:32.412351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:32.412351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:32.412351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:32.412691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:32.412974 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:32.413410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:32.549032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:32.556659 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5c2f9ef3-3053-4166-9e65-6b763e513cfe tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.163939 Aug 05 15:38:32.557222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 365/735] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:32 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:32.729035 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-73735b7a-581b-46f5-b80f-5f7d7efed181 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.322268 Aug 05 15:38:32.730042 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 371/736] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:38:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:38:32.742089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a930fffc-2d0b-4e12-adff-534cc07ab967 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:32.742707 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a930fffc-2d0b-4e12-adff-534cc07ab967 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:32.797298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a930fffc-2d0b-4e12-adff-534cc07ab967 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:32.804449 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a930fffc-2d0b-4e12-adff-534cc07ab967 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1094 microversion: 2.1 time: 0.066951 Aug 05 15:38:32.805214 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 366/737] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:32 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:33.578625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:33.579452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:33.585483 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:33.585962 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:33.586395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:33.587088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:33.587541 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:33.587964 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:33.713105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:33.720907 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-27381683-f29c-458c-9e50-11caf3a6e3e7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.146790 Aug 05 15:38:33.721464 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 372/738] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:33 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:33.825059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:33.825661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:33.832146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:33.832564 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:33.832988 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:33.833706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:33.834132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:33.834546 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:33.896563 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:33.904106 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-79f28e75-913b-476b-8751-502092aed4e0 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1144 microversion: 2.1 time: 0.082949 Aug 05 15:38:33.904663 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 367/739] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:33 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:34.742272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:34.742871 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:34.749003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:34.749481 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:34.749952 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:34.750663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:34.751100 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:34.752119 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:34.886319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:34.895614 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8f5cb39e-1e09-4376-ad5f-eea741ae8954 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.157268 Aug 05 15:38:34.900333 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 373/740] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:34 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:34.925538 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:34.926143 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:34.932850 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:34.933451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:34.933960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:34.934648 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:34.935096 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:34.935557 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:34.998679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:35.006782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-fe1d41f6-4388-4f74-aa84-f90c895d728d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1136 microversion: 2.1 time: 0.085824 Aug 05 15:38:35.007405 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 368/741] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:34 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:35.917258 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:35.917896 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:35.924639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:35.925128 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:35.925563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:35.926266 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:35.926716 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:35.927147 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:36.027903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:36.029677 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:36.035317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:36.036004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:36.036510 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:36.037204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:36.037654 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:36.038074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:36.064611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:36.072628 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8b368272-b0c9-4020-aee4-24fdd8a4c2b1 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.159287 Aug 05 15:38:36.084539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 374/742] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:35 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:36.104626 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:36.112188 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f4d6374b-ae53-4870-acda-7211d6a79276 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1210 microversion: 2.1 time: 0.088390 Aug 05 15:38:36.112850 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 369/743] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:36 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:36.788143 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-c7c77f53-9db7-489e-bd02-66edfe3b26a0 req-42290cf2-48c8-47c0-9abf-e9d16afe34c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1249d2a6-8c0f-4e2d-96e8-a729292dff7d", "name": "network-vif-plugged", "status": "completed", "tag": "8ceb2c80-ad1b-48fb-9eac-c2e9ec5aae5d"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:36.798932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c7c77f53-9db7-489e-bd02-66edfe3b26a0 req-42290cf2-48c8-47c0-9abf-e9d16afe34c8 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:36.799408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c7c77f53-9db7-489e-bd02-66edfe3b26a0 req-42290cf2-48c8-47c0-9abf-e9d16afe34c8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:36.799834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c7c77f53-9db7-489e-bd02-66edfe3b26a0 req-42290cf2-48c8-47c0-9abf-e9d16afe34c8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:36.811481 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-c7c77f53-9db7-489e-bd02-66edfe3b26a0 req-42290cf2-48c8-47c0-9abf-e9d16afe34c8 service nova] Creating event network-vif-plugged:8ceb2c80-ad1b-48fb-9eac-c2e9ec5aae5d for instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d on hv-cinder-84989 Aug 05 15:38:36.816785 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-c7c77f53-9db7-489e-bd02-66edfe3b26a0 req-42290cf2-48c8-47c0-9abf-e9d16afe34c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 Aug 05 15:38:36.817386 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 375/744] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:37.093547 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:37.094089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:37.100667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:37.101159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:37.101573 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:37.102261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:37.102707 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:37.103127 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:37.139303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:37.140761 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:37.160516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:37.160516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:37.160516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:37.160516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:37.160870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:37.160870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:37.335321 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:37.339017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=100 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:37.343666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1be88cd9-673a-4e72-b27a-d0e28f13deaf tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.253870 Aug 05 15:38:37.344158 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 370/745] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:37 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:37.362842 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:37.370857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-916ea6e6-4f4e-410a-b2b9-d23b996af4d5 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1278 microversion: 2.1 time: 0.239735 Aug 05 15:38:37.371442 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 376/746] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:37 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:37.383914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-78250477-4600-4d30-b287-516e26c16297 req-4929f5c3-beea-4bcb-bb83-b63b5e0e21f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d75ad1-7ef8-42aa-b898-36ff34c67162", "tag": "bedd8c00-a5cc-4970-b3d9-dab948345d16"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:37.394303 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-78250477-4600-4d30-b287-516e26c16297 req-4929f5c3-beea-4bcb-bb83-b63b5e0e21f9 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:37.396628 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-78250477-4600-4d30-b287-516e26c16297 req-4929f5c3-beea-4bcb-bb83-b63b5e0e21f9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:37.396628 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-78250477-4600-4d30-b287-516e26c16297 req-4929f5c3-beea-4bcb-bb83-b63b5e0e21f9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:37.406689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-78250477-4600-4d30-b287-516e26c16297 req-4929f5c3-beea-4bcb-bb83-b63b5e0e21f9 service nova] Creating event network-changed:bedd8c00-a5cc-4970-b3d9-dab948345d16 for instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 on hv-cinder-84989 Aug 05 15:38:37.411999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-78250477-4600-4d30-b287-516e26c16297 req-4929f5c3-beea-4bcb-bb83-b63b5e0e21f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035717 Aug 05 15:38:37.412694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 371/747] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:38:38.365036 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:38.365596 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:38.371933 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:38.372458 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:38.372911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:38.373625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:38.374080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:38.374502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:38.393249 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:38.394101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:38.401413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:38.402004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:38.402525 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:38.403283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:38.403796 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:38.404343 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:38.565722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:38.569314 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=100 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:38.573659 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-10963aef-0c76-48c2-87b0-f35d1bec92d7 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1315 microversion: 2.1 time: 0.212646 Aug 05 15:38:38.574305 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 377/748] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:38 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:38.590687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:38.598356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a294d0a3-84ad-4c4b-835a-17f0e98bc50b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1278 microversion: 2.1 time: 0.210153 Aug 05 15:38:38.598912 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 372/749] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:38 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:39.595165 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:39.595816 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:39.602432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:39.602856 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:39.603294 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:39.604091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:39.604506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:39.604931 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:39.619861 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:39.620565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:39.627647 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:39.628158 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:39.628593 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:39.629285 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:39.629733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:39.630186 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:39.825420 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:39.832690 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a12b9ed8-9689-42b8-a18d-22a13855f226 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1465 microversion: 2.1 time: 0.241671 Aug 05 15:38:39.833314 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 378/750] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:39 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1465 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:39.850384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:39.858829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2cab33c9-7235-41d3-b809-202b0e8a2bde tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.242819 Aug 05 15:38:39.878690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 373/751] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:39 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:39.885139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:39.885663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:39.892164 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:39.892640 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:39.893286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:39.894162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:39.894611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:39.895030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:39.921945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Going to try to terminate instance {{(pid=118723) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:38:40.117745 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:40.180394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-067184cc-ad14-4165-b4b9-cbedd3f12861 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 204 len: 0 microversion: 2.1 time: 0.300215 Aug 05 15:38:40.180987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 379/752] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:38:39 2022] DELETE /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 15:38:40.189163 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:40.192634 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:40.195812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:40.196331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:40.196764 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:40.197452 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:40.197906 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:40.198330 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:40.327420 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:40.335237 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-55cb7b08-4692-46db-8f14-63b70b111ddb tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1471 microversion: 2.1 time: 0.149977 Aug 05 15:38:40.335796 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 374/753] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:40 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:40.885081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:40.885781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:40.892383 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:40.892877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:40.893321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:40.894027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:40.894486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:40.894918 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:41.022512 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:41.030122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8ebe233a-2b52-450a-a0b3-8d18395b4a01 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.149495 Aug 05 15:38:41.030696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 380/754] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:40 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:41.356243 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:41.356864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:41.359296 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:41.364722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:41.372297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:41.372297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:41.372297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:41.372297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:41.372854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:41.497549 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:41.505289 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5d81ef5b-491c-4106-8a47-5b80a7aa54da tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1471 microversion: 2.1 time: 0.152951 Aug 05 15:38:41.505851 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 375/755] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:41 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:42.050928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:42.051487 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:42.057868 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:42.058351 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:42.058786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:42.059476 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:42.059933 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:42.060386 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:42.167072 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:42.187653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=6 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:42.194782 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:42.202273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7c2d15cd-ff57-440b-8aee-0bc7df9083cd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.155326 Aug 05 15:38:42.202844 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 381/756] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:42 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:42.526990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:42.527596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:42.533982 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:42.534482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:42.534913 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:42.535592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:42.536096 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:42.536525 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:42.661581 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:42.669004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c5a911c9-810d-4648-9a0f-bb6acbcbcf38 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1471 microversion: 2.1 time: 0.146098 Aug 05 15:38:42.669559 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 376/757] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:42 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:43.224942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:43.225803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:43.232341 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:43.232825 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:43.233331 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:43.234004 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:43.234458 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:43.239025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:43.366362 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:43.374991 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1e72a83d-4172-47df-8b56-a514db1ae4ce tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.155309 Aug 05 15:38:43.375559 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 382/758] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:43 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:43.690970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:43.691584 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:43.693434 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:38:43.698857 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:43.699346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:43.703257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:43.703257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:43.703257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:43.703257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:43.833857 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:43.841542 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9b3e964e-912d-427e-aaa3-1c72bcf66c92 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1471 microversion: 2.1 time: 0.154940 Aug 05 15:38:43.842114 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 377/759] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:43 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:44.215120 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-ded0e734-24a3-4fc4-820f-d05023dca1a0 req-ce97f61b-934d-4554-a4cc-c0c0f53d4b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1249d2a6-8c0f-4e2d-96e8-a729292dff7d", "name": "network-vif-deleted", "tag": "8ceb2c80-ad1b-48fb-9eac-c2e9ec5aae5d"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:44.225419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-ded0e734-24a3-4fc4-820f-d05023dca1a0 req-ce97f61b-934d-4554-a4cc-c0c0f53d4b23 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:44.226283 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-ded0e734-24a3-4fc4-820f-d05023dca1a0 req-ce97f61b-934d-4554-a4cc-c0c0f53d4b23 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:44.226394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-ded0e734-24a3-4fc4-820f-d05023dca1a0 req-ce97f61b-934d-4554-a4cc-c0c0f53d4b23 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:44.238296 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-ded0e734-24a3-4fc4-820f-d05023dca1a0 req-ce97f61b-934d-4554-a4cc-c0c0f53d4b23 service nova] Creating event network-vif-deleted:8ceb2c80-ad1b-48fb-9eac-c2e9ec5aae5d for instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d on hv-cinder-84989 Aug 05 15:38:44.243238 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-ded0e734-24a3-4fc4-820f-d05023dca1a0 req-ce97f61b-934d-4554-a4cc-c0c0f53d4b23 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031964 Aug 05 15:38:44.243891 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 383/760] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:44.396361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:44.397012 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:44.403181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:44.406059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:44.406059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:44.406059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:44.406059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:44.406438 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:44.537893 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:44.545458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ce2f82ed-915b-46bc-8045-b923d71c38e9 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.153353 Aug 05 15:38:44.546012 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 378/761] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:44 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:44.863285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:44.863982 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:44.870186 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:44.870678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:44.871118 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:44.871811 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:44.872303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:44.872729 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:44.904440 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:44.904997 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:44.905439 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:44.905884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lazy-loading 'fault' on Instance uuid 1249d2a6-8c0f-4e2d-96e8-a729292dff7d {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:38:44.949586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f4a016c52647db95dfdd2c29c7bec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd3963551a44ea8a6f9f5829f7d2332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:44.957646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a374ef86-9813-46b6-b0bc-502f451fe7f5 tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 200 len: 1305 microversion: 2.1 time: 0.098696 Aug 05 15:38:44.958188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 384/762] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:44 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:45.566359 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:45.566976 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:45.573400 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:45.573908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:45.574321 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:45.575017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:45.575470 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:45.575896 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:45.706907 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:45.714601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d74c3704-4ca3-4501-99ab-2ed01aa8a72e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.152601 Aug 05 15:38:45.715115 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 379/763] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:45 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:45.978041 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:45.978592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] [instance: 1249d2a6-8c0f-4e2d-96e8-a729292dff7d] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:45.984985 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:45.989666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:45.989666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:45.989666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:45.989666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:45.990027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:46.000803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] HTTP exception thrown: Instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d could not be found. Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Request method failure captured: Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d HTTP/1.1 Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7Tlq5Nr9yaAwwEi3zeY7B9fSxyo_lxZo61aqxoqD68gxJt0vk7Dsx3nsWfEiaVgd-6cdZuaxvndRjS_qy014PxvK8PAMt6VaBhoi7prz4bNTqsy3h8yX6ik-84Nz_AD9l1XQbjwlOmwyg1Q9Pk_2OfFCEXB2h3wLa329qRcBicAo_aE Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: acd3963551a44ea8a6f9f5829f7d2332 Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-VolumesNegativeTest-1065972952 Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:38:46.002543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_acd3963551a44ea8a6f9f5829f7d2332", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acd3963551a44ea8a6f9f5829f7d2332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acd3963551a44ea8a6f9f5829f7d2332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/acd3963551a44ea8a6f9f5829f7d2332"}]}] Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-VolumesNegativeTest-1065972952 Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: acd3963551a44ea8a6f9f5829f7d2332 Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-VolumesNegativeTest-1065972952 Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-VolumesNegativeTest-1065972952-project Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 22f4a016c52647db95dfdd2c29c7bec3 Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-VolumesNegativeTest-1065972952-project Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d could not be found. Aug 05 15:38:46.004197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '1249d2a6-8c0f-4e2d-96e8-a729292dff7d'} Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d could not be found. Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:38:46.005081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d could not be found. Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d could not be found. Aug 05 15:38:46.006609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:38:46.008235 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] Returning 404 to user: Instance 1249d2a6-8c0f-4e2d-96e8-a729292dff7d could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:38:46.008235 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3ec229bd-a467-4524-9a60-300909f3fc9d tempest-VolumesNegativeTest-1065972952 tempest-VolumesNegativeTest-1065972952-project] 10.222.0.40 "GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d" status: 404 len: 111 microversion: 2.1 time: 0.029834 Aug 05 15:38:46.008235 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 385/764] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:45 2022] GET /compute/v2.1/servers/1249d2a6-8c0f-4e2d-96e8-a729292dff7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:38:46.738413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:46.739025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:46.745591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:46.746075 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:46.746512 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:46.747209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:46.747660 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:46.748113 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:46.890794 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:46.899594 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ca603b84-8326-4b67-8f4b-244e9f174278 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.165249 Aug 05 15:38:46.901103 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 380/765] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:46 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:47.921810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:47.922464 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:47.929689 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:47.930166 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:47.930598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:47.931286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:47.931737 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:47.932187 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:48.073787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:48.081776 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5cc007e3-b691-4bab-b53e-034438a3a5c3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.163886 Aug 05 15:38:48.082430 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 386/766] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:47 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:48.855035 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-1eec7875-c12f-49ce-981b-09a04fb1e2a1 req-c01924f7-4021-47bb-933b-4feb4d628197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d75ad1-7ef8-42aa-b898-36ff34c67162", "name": "network-vif-plugged", "status": "completed", "tag": "bedd8c00-a5cc-4970-b3d9-dab948345d16"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:48.865164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-1eec7875-c12f-49ce-981b-09a04fb1e2a1 req-c01924f7-4021-47bb-933b-4feb4d628197 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:48.865640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-1eec7875-c12f-49ce-981b-09a04fb1e2a1 req-c01924f7-4021-47bb-933b-4feb4d628197 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:48.866065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-1eec7875-c12f-49ce-981b-09a04fb1e2a1 req-c01924f7-4021-47bb-933b-4feb4d628197 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:48.877320 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-1eec7875-c12f-49ce-981b-09a04fb1e2a1 req-c01924f7-4021-47bb-933b-4feb4d628197 service nova] Creating event network-vif-plugged:bedd8c00-a5cc-4970-b3d9-dab948345d16 for instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 on hv-cinder-84989 Aug 05 15:38:48.883537 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-1eec7875-c12f-49ce-981b-09a04fb1e2a1 req-c01924f7-4021-47bb-933b-4feb4d628197 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031824 Aug 05 15:38:48.883537 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 381/767] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:49.104034 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:49.105472 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:49.112432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:49.112910 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:49.113343 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:49.114031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:49.114481 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:49.114905 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:49.253372 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:49.261557 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2a2c3c02-a4a6-477c-b29a-7e5535232b0e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.162705 Aug 05 15:38:49.262228 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 387/768] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:49 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:50.282706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:50.283401 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:50.290095 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:50.293138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:50.293138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:50.293138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:50.293138 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:50.293548 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:50.442201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:50.452164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b0c3c243-d7e1-4c95-9c94-3d52c26041ee tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1266 microversion: 2.1 time: 0.171868 Aug 05 15:38:50.452164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 382/769] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:50 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:51.471484 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:51.472201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:51.478654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:51.479133 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:51.479568 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:51.480288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:51.480810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:51.481168 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:51.615423 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:51.623242 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2609a076-9c48-46c7-ab7c-b338dfa2d410 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1453 microversion: 2.1 time: 0.156284 Aug 05 15:38:51.623822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 388/770] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:51 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:38:51.644209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:51.644683 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:51.651466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:51.651946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:51.652427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:51.653121 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:51.653614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:51.654032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:51.795424 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:51.803019 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-570e36fb-726c-42c7-852e-e82cad401948 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1453 microversion: 2.1 time: 0.163360 Aug 05 15:38:51.803576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 383/771] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:51 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:38:54.287376 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-9bb1be42-2e7a-4fb5-987c-3d781b55394d req-3d56df60-3fb4-47b7-b44c-3f2243da64a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d75ad1-7ef8-42aa-b898-36ff34c67162", "tag": "bedd8c00-a5cc-4970-b3d9-dab948345d16"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:54.299727 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-9bb1be42-2e7a-4fb5-987c-3d781b55394d req-3d56df60-3fb4-47b7-b44c-3f2243da64a7 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:54.300239 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-9bb1be42-2e7a-4fb5-987c-3d781b55394d req-3d56df60-3fb4-47b7-b44c-3f2243da64a7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:54.300771 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-9bb1be42-2e7a-4fb5-987c-3d781b55394d req-3d56df60-3fb4-47b7-b44c-3f2243da64a7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:54.315099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-9bb1be42-2e7a-4fb5-987c-3d781b55394d req-3d56df60-3fb4-47b7-b44c-3f2243da64a7 service nova] Creating event network-changed:bedd8c00-a5cc-4970-b3d9-dab948345d16 for instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 on hv-cinder-84989 Aug 05 15:38:54.321449 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-9bb1be42-2e7a-4fb5-987c-3d781b55394d req-3d56df60-3fb4-47b7-b44c-3f2243da64a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039719 Aug 05 15:38:54.325749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 389/772] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:38:58.586921 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1752332730", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "networks": [{"uuid": "d38f37ed-3cc5-47f6-8fc2-0e6649cca615"}]}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:38:58.650031 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] validate_networks() for [('d38f37ed-3cc5-47f6-8fc2-0e6649cca615', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:38:59.305073 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:38:59.305679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:38:59.306258 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:38:59.306773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:38:59.307294 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:38:59.318001 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:59.318496 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:59.318971 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:59.319716 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:38:59.320204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:38:59.320638 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:38:59.338205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Getting quotas for project 39c62721dfdd46e3978fccce91b63791. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:38:59.342163 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Getting quotas for user 8cfb345e7c044b669ec6c4a6a79a28ee and project 39c62721dfdd46e3978fccce91b63791. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:38:59.353008 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:38:59.355255 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:38:59.580427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-354ea32e-d26f-4bfb-963f-b53424ea080f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004918 Aug 05 15:38:59.581094 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 384/773] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:38:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:38:59.593433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2e1c9ca1-da4f-446f-a169-e0283344e5dd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:38:59.594228 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2e1c9ca1-da4f-446f-a169-e0283344e5dd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:38:59.654969 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2e1c9ca1-da4f-446f-a169-e0283344e5dd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:38:59.664004 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2e1c9ca1-da4f-446f-a169-e0283344e5dd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1219 microversion: 2.1 time: 0.075468 Aug 05 15:38:59.664672 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 390/774] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:38:59 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:00.538681 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:00.539248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:00.547605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:00.548286 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:00.548730 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:00.549430 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:00.549887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:00.550306 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:00.574875 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8ce413d6-4a46-41d0-a4a7-cc92936c88f8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/ips" status: 200 len: 149 microversion: 2.1 time: 0.040334 Aug 05 15:39:00.583067 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 385/775] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:39:00 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:00.685468 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:00.686346 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:00.701875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:00.702730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:00.703532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:00.706209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:00.706209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:00.707141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:00.775236 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:00.782943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ef366e73-f3c3-4758-8ed3-c1f86cf7b468 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1223 microversion: 2.1 time: 0.101444 Aug 05 15:39:00.783503 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 391/776] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:00 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:01.804362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:01.805127 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:01.817922 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:01.818772 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:01.819417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:01.820492 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:01.821173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:01.821770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:01.909957 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:01.918875 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-533b2f73-721d-442c-93ee-3182b9052371 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1271 microversion: 2.1 time: 0.118613 Aug 05 15:39:01.936161 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 386/777] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:01 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:02.641842 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d41c844e-3410-4ddf-a69b-9d929c8052fb"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:02.645076 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:02.652528 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:02.653030 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:02.653698 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:02.654582 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:02.655192 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:02.655771 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:02.942803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:02.944261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:02.953247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:02.955122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:02.955122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:02.955759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:02.956498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:02.957084 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:03.029230 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:03.038765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-aeb55b89-6cc1-4e6b-bc1b-63e4c89e8015 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1277 microversion: 2.1 time: 0.100481 Aug 05 15:39:03.040110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 387/778] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:02 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:03.450222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-439939b3-163a-4690-81a4-feaada602941 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811509 Aug 05 15:39:03.459390 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 392/779] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:39:02 2022] POST /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:04.060571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:04.061823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:04.068984 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:04.069928 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:04.070310 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:04.071177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:04.071800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:04.072266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:04.269470 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:04.277543 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-35b0f591-b3f1-4c2f-a410-f6f856912a9f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1319 microversion: 2.1 time: 0.220708 Aug 05 15:39:04.278512 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 388/780] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:04 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:04.355536 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-176848ff-e0df-467b-88bf-67ce77780555 req-57c5b6b7-db00-4608-8f8b-161f084d8965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14259f76-1a5c-4c5f-93d2-10d5b7921b19", "tag": "2bcc4a82-2d8e-49ad-9ec1-b159196d26b0"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:04.377058 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-176848ff-e0df-467b-88bf-67ce77780555 req-57c5b6b7-db00-4608-8f8b-161f084d8965 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:04.377575 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-176848ff-e0df-467b-88bf-67ce77780555 req-57c5b6b7-db00-4608-8f8b-161f084d8965 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:04.378015 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-176848ff-e0df-467b-88bf-67ce77780555 req-57c5b6b7-db00-4608-8f8b-161f084d8965 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:04.398632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-176848ff-e0df-467b-88bf-67ce77780555 req-57c5b6b7-db00-4608-8f8b-161f084d8965 service nova] Creating event network-changed:2bcc4a82-2d8e-49ad-9ec1-b159196d26b0 for instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 on hv-cinder-84989 Aug 05 15:39:04.404788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-176848ff-e0df-467b-88bf-67ce77780555 req-57c5b6b7-db00-4608-8f8b-161f084d8965 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053758 Aug 05 15:39:04.406207 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 393/781] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:05.299467 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:05.302363 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:05.309529 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:05.310019 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:05.310448 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:05.311482 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:05.311937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:05.312383 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:05.582716 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:05.586802 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=100 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:05.592116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f48ecfe9-09f3-4914-b696-4b8f54fed2ee tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1319 microversion: 2.1 time: 0.297054 Aug 05 15:39:05.594451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 389/782] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:05 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:05.927099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-be0687dc-6987-42bc-a22d-7137d0453f77 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Action: 'create', calling method: .version_select at 0x7fcb14d84310>, body: {"keypair": {"name": "tempest-TestShelveInstance-618991783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaBO2vxj8pZd5zekY4Y5catva7RRcq5XWove+SJak+00vhNeJ+LWj+jzfqe+wWChtWHlWCy7z3ARkE6lCzc0CgjuM/RVCBBijNBExjSYZX+qT/b4tlPDK0TRuV0k1mByQ=="}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:05.947045 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-be0687dc-6987-42bc-a22d-7137d0453f77 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Getting quotas for project 7b3f679565d546ff8e6418643699c002. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:39:05.951799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-be0687dc-6987-42bc-a22d-7137d0453f77 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Getting quotas for user f2a7a3b126294571a8586b6e7b43056c and project 7b3f679565d546ff8e6418643699c002. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:39:06.058006 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-be0687dc-6987-42bc-a22d-7137d0453f77 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.347018 Aug 05 15:39:06.058625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 394/783] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:39:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:06.617289 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:06.618218 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:06.626672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:06.627460 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:06.630760 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:06.630760 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:06.630760 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:06.630760 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:06.802946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:06.809788 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-45c3d579-91e4-45cd-822a-c4e3ca391190 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1319 microversion: 2.1 time: 0.197120 Aug 05 15:39:06.810366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 390/784] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:06 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:07.833108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:07.835333 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:07.842278 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:07.842917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:07.843204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:07.843908 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:07.844495 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:07.845599 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:07.978451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:07.982183 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:07.986713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-10067665-2f22-4f7a-a138-cc8874b6ee5a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1319 microversion: 2.1 time: 0.159812 Aug 05 15:39:07.999674 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 395/785] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:07 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:09.006713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:09.007318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:09.014141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:09.014565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:09.014995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:09.015892 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:09.016377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:09.016837 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:09.162495 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:09.176001 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-dd42b0d9-5861-440b-8d15-4c4502a09cfb tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1319 microversion: 2.1 time: 0.173054 Aug 05 15:39:09.176603 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 391/786] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:09 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:39:10.197544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:10.198188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:10.205106 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:10.205623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:10.206103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:10.206813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:10.207298 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:10.207745 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:10.349260 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:10.356774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0145f624-5c4b-4700-a023-e447a2c15063 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1319 microversion: 2.1 time: 0.163683 Aug 05 15:39:10.357331 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 396/787] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:10 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:39:10.977215 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-671b1bde-7ae6-4e19-b5c6-8dc7c05084e3 req-f4deaa79-1031-422e-b99b-1dd91088b261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14259f76-1a5c-4c5f-93d2-10d5b7921b19", "name": "network-vif-plugged", "status": "completed", "tag": "2bcc4a82-2d8e-49ad-9ec1-b159196d26b0"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:10.985501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:10.985501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=6 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:10.989758 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-671b1bde-7ae6-4e19-b5c6-8dc7c05084e3 req-f4deaa79-1031-422e-b99b-1dd91088b261 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:10.990227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-671b1bde-7ae6-4e19-b5c6-8dc7c05084e3 req-f4deaa79-1031-422e-b99b-1dd91088b261 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:10.990693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-671b1bde-7ae6-4e19-b5c6-8dc7c05084e3 req-f4deaa79-1031-422e-b99b-1dd91088b261 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:11.005768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-671b1bde-7ae6-4e19-b5c6-8dc7c05084e3 req-f4deaa79-1031-422e-b99b-1dd91088b261 service nova] Creating event network-vif-plugged:2bcc4a82-2d8e-49ad-9ec1-b159196d26b0 for instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 on hv-cinder-84989 Aug 05 15:39:11.011060 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-671b1bde-7ae6-4e19-b5c6-8dc7c05084e3 req-f4deaa79-1031-422e-b99b-1dd91088b261 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038388 Aug 05 15:39:11.011648 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 392/788] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:11.067003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9b42c4b3-fc92-4b52-b3c1-27b8b2c2b8b2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: .version_select at 0x7fcb14d2c4c0>, body: {"keypair": {"name": "tempest-keypair-1762313945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsWb8rT5K1qiYkhB93LdfXPrbNdxo0+nsPi+ad+aBHMHaLw3X+zcoLvVh61M3pARLfgEdAsy43Ema/3B01SNp06sO6Ebumntp0gYvutvAmtOe2bwPMaEo23UjwTSSIjGA=="}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:11.075690 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:11.084739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-9b42c4b3-fc92-4b52-b3c1-27b8b2c2b8b2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for project 2c77da48edba4903a1c51fee2a856167. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:39:11.089470 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-9b42c4b3-fc92-4b52-b3c1-27b8b2c2b8b2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for user dd5c43d63a754eeaaba429f5c8153bba and project 2c77da48edba4903a1c51fee2a856167. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:39:11.183506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9b42c4b3-fc92-4b52-b3c1-27b8b2c2b8b2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120888 Aug 05 15:39:11.184141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 397/789] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:39:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:11.380578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:11.381299 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:11.387877 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:11.388382 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:11.388814 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:11.389532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:11.389968 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:11.390392 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:11.551637 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:11.559956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-6c65005d-2735-421b-b4f4-d8588d6828bd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1319 microversion: 2.1 time: 0.184779 Aug 05 15:39:11.560607 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 393/790] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:11 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:12.583947 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:12.584675 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:12.591251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:12.591964 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:12.592436 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:12.593139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:12.593684 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:12.594506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:12.743816 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:12.751147 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b8c0dc44-73eb-42e0-ade6-762e3e845553 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1319 microversion: 2.1 time: 0.172143 Aug 05 15:39:12.751702 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 398/791] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:12 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:13.528458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1594359459", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b05605aa-dd0e-428b-8865-2528537f12f7"}], "security_groups": [{"name": "tempest-securitygroup--98668850"}], "key_name": "tempest-keypair-1762313945", "user_data": "}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:13.537011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:13.633660 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] validate_networks() for [('b05605aa-dd0e-428b-8865-2528537f12f7', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:39:13.771057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:13.771694 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:13.778826 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:13.779308 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:13.779745 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:13.780475 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:13.780928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:13.781352 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:13.995471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:14.003022 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-270dfbd0-b835-47a2-bba0-3fbe6600275b tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1508 microversion: 2.1 time: 0.235872 Aug 05 15:39:14.003594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 399/792] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:13 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:39:14.095946 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:39:14.096415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:39:14.097118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:39:14.097530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:39:14.097937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:39:14.107961 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:14.108740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:14.109263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:14.110347 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:14.110844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:14.111432 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:14.130750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for project 2c77da48edba4903a1c51fee2a856167. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:39:14.134721 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for user dd5c43d63a754eeaaba429f5c8153bba and project 2c77da48edba4903a1c51fee2a856167. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:39:14.146282 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:39:14.149101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:39:14.293167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e78bfa8a-77c6-4ecd-a79c-5a188e5371fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.769607 Aug 05 15:39:14.294147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 394/793] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:39:13 2022] POST /compute/v2.1/servers => generated 400 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:39:14.305159 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0fd1452b-0a97-4a29-91d4-72ee7f48fe80 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:14.306085 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0fd1452b-0a97-4a29-91d4-72ee7f48fe80 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:14.361991 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0fd1452b-0a97-4a29-91d4-72ee7f48fe80 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:14.368885 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0fd1452b-0a97-4a29-91d4-72ee7f48fe80 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1242 microversion: 2.1 time: 0.067736 Aug 05 15:39:14.369460 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 400/794] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:14 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:39:15.398769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:15.399740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:15.408498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:15.409553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:15.409993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:15.410731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:15.411184 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:15.411615 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:15.473546 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:15.482032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-cf4ce6f1-609f-41df-8768-f1d63c0a064e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1246 microversion: 2.1 time: 0.093928 Aug 05 15:39:15.485625 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 395/795] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:15 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:16.503255 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:16.503900 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:16.510415 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:16.510943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:16.511437 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:16.512166 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:16.512630 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:16.513056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:16.578211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:16.585884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3d0a92e0-69a3-4045-a407-2ecde99c536f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1302 microversion: 2.1 time: 0.087034 Aug 05 15:39:16.586463 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 401/796] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:16 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:17.612846 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:17.613633 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:17.622628 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:17.623225 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:17.623726 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:17.624509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:17.624972 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:17.628101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:17.774771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:17.784409 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e69556dd-94c2-421d-a2cf-803476f5eac3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.175621 Aug 05 15:39:17.785333 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 396/797] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:17 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:18.315869 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-c125f7f6-dd54-4a72-989d-595286cb1b75 req-615d0402-c84b-4247-9d1f-b808f3f2da92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59fb549a-27e1-4a42-b47c-1f04bd4d23ca", "tag": "7a2f96a7-b8b4-4db4-a743-a5bfa13076a5"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:18.331986 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c125f7f6-dd54-4a72-989d-595286cb1b75 req-615d0402-c84b-4247-9d1f-b808f3f2da92 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:18.332679 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c125f7f6-dd54-4a72-989d-595286cb1b75 req-615d0402-c84b-4247-9d1f-b808f3f2da92 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:18.333121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c125f7f6-dd54-4a72-989d-595286cb1b75 req-615d0402-c84b-4247-9d1f-b808f3f2da92 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:18.347301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-c125f7f6-dd54-4a72-989d-595286cb1b75 req-615d0402-c84b-4247-9d1f-b808f3f2da92 service nova] Creating event network-changed:7a2f96a7-b8b4-4db4-a743-a5bfa13076a5 for instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca on hv-cinder-84989 Aug 05 15:39:18.352758 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-c125f7f6-dd54-4a72-989d-595286cb1b75 req-615d0402-c84b-4247-9d1f-b808f3f2da92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042892 Aug 05 15:39:18.353367 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 402/798] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:39:18.805666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:18.806407 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:18.812880 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:18.813357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:18.813826 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:18.814516 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:18.815007 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:18.815444 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:18.955262 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:18.974948 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-25a8e512-54ac-40c3-8801-7fa1091a82ab tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.168647 Aug 05 15:39:18.975710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 397/799] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:18 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:19.999585 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:20.000859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:20.009285 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:20.010074 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:20.010807 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:20.011675 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:20.012234 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:20.012678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:20.147122 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:20.154680 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5850a3e9-d125-4d56-bc55-119b5717ccd5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.159847 Aug 05 15:39:20.155236 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 403/800] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:19 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:21.175988 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:21.176626 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:21.182985 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:21.183710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:21.184177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:21.184857 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:21.185305 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:21.185724 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:21.316273 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:21.323643 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-237125bb-1205-4aae-83bc-792574a7063c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.151672 Aug 05 15:39:21.324235 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 398/801] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:21 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:22.345071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:22.345632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:22.352579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:22.353064 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:22.353505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:22.354199 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:22.354658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:22.355085 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:22.486890 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:22.491031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1155458e-d75a-4f66-ba7c-3221cdaf11af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.149973 Aug 05 15:39:22.491599 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 404/802] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:22 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:23.515074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:23.515074 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:23.518768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:23.519253 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:23.519697 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:23.520932 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:23.521453 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:23.521887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:23.654254 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:23.662627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-da3b5d9f-d560-4432-857e-852d2290058d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.154741 Aug 05 15:39:23.663204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 399/803] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:23 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:24.683870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:24.684409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:24.686877 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=12 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:24.691599 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:24.692093 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:24.693928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:24.693928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:24.693928 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:24.694239 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:24.826143 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:24.833618 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-2a08839e-66c8-45f8-af47-e3b6c0cd8e6d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.153624 Aug 05 15:39:24.834385 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 405/804] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:24 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:25.854501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:25.855107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:25.856963 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:25.857673 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=6 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:25.862812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:25.863292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:25.864245 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:25.864997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:25.865451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:25.865880 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:25.998199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:26.006197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-aee6c31d-0c8a-4293-a094-2cedfb0c298c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.155484 Aug 05 15:39:26.006767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 400/805] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:25 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:27.028177 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:27.030939 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:27.036980 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-ead18c63-7a72-4d01-9aa6-2a9a46a75e53 req-aeec4556-b7c6-4193-8edc-c82676c5b57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fb549a-27e1-4a42-b47c-1f04bd4d23ca", "name": "network-vif-plugged", "status": "completed", "tag": "7a2f96a7-b8b4-4db4-a743-a5bfa13076a5"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:27.037841 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:27.039438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:27.039879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:27.040624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:27.041079 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:27.041532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:27.047257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-ead18c63-7a72-4d01-9aa6-2a9a46a75e53 req-aeec4556-b7c6-4193-8edc-c82676c5b57f service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:27.047738 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-ead18c63-7a72-4d01-9aa6-2a9a46a75e53 req-aeec4556-b7c6-4193-8edc-c82676c5b57f service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:27.048263 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-ead18c63-7a72-4d01-9aa6-2a9a46a75e53 req-aeec4556-b7c6-4193-8edc-c82676c5b57f service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:27.060116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-ead18c63-7a72-4d01-9aa6-2a9a46a75e53 req-aeec4556-b7c6-4193-8edc-c82676c5b57f service nova] Creating event network-vif-plugged:7a2f96a7-b8b4-4db4-a743-a5bfa13076a5 for instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca on hv-cinder-84989 Aug 05 15:39:27.066013 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-ead18c63-7a72-4d01-9aa6-2a9a46a75e53 req-aeec4556-b7c6-4193-8edc-c82676c5b57f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033339 Aug 05 15:39:27.066619 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 401/806] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:27.181121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:27.188564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e04b5fc8-89c2-4a44-8b73-c1a89f8398f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.165648 Aug 05 15:39:27.189127 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 406/807] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:27 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:28.209873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:28.210636 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:28.217739 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:28.218230 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:28.218663 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:28.219368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:28.219811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:28.220271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:28.356344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:28.362047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-cc8c99c7-1002-4aa4-838d-6f88ca034822 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1366 microversion: 2.1 time: 0.156453 Aug 05 15:39:28.362834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 402/808] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:28 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:28.676778 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-159219466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-618991783", "security_groups": [{"name": "tempest-secgroup-smoke-1658047509"}], "networks": [{"uuid": "a6b6686e-428b-46bc-8365-eafa91007418"}], "block_device_mapping_v2": [{"uuid": "950beca2-90e1-4c7b-9e88-58f8cf132da7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:28.793591 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] validate_networks() for [('a6b6686e-428b-46bc-8365-eafa91007418', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:39:29.163584 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:39:29.164011 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:39:29.164520 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:39:29.164932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:39:29.165377 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:39:29.174594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:29.176940 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:29.176940 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:29.176940 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:29.180741 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:29.180741 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:29.194791 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Getting quotas for project 7b3f679565d546ff8e6418643699c002. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:39:29.198869 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Getting quotas for user f2a7a3b126294571a8586b6e7b43056c and project 7b3f679565d546ff8e6418643699c002. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:39:29.255440 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:39:29.257544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='950beca2-90e1-4c7b-9e88-58f8cf132da7',volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:39:29.382858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:29.383492 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:29.390100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:29.390575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:29.391059 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:29.391743 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:29.392236 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:29.392659 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:29.541465 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:29.549272 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c42f663a-5709-493c-a1bc-7b72f2f64b3f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1556 microversion: 2.1 time: 0.170467 Aug 05 15:39:29.549851 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 403/809] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:29 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:39:29.570494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:29.571379 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:29.576720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:29.577194 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:29.577622 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:29.578301 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:29.578744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:29.579159 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:29.654593 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0da8e33c-a0cf-43e4-8e3b-09b20c25b3f3 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088424 Aug 05 15:39:29.655181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 404/810] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 15:39:29 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:39:29.658596 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-23242327-044b-4b72-9895-fa78f7f664a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.986036 Aug 05 15:39:29.659349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 407/811] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:39:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:39:29.670757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1b7184c2-d13b-4f23-b719-9cf6a150b567 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:29.671778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1b7184c2-d13b-4f23-b719-9cf6a150b567 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:29.743928 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1b7184c2-d13b-4f23-b719-9cf6a150b567 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:29.746215 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1b7184c2-d13b-4f23-b719-9cf6a150b567 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1087 microversion: 2.1 time: 0.079976 Aug 05 15:39:29.746973 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 405/812] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:29 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:30.689512 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-2ac83f77-d5cd-41a8-a2f5-3705fa1463ed req-d4292839-a00d-46ea-9407-1e72b8b5fcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59fb549a-27e1-4a42-b47c-1f04bd4d23ca", "tag": "7a2f96a7-b8b4-4db4-a743-a5bfa13076a5"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:30.700170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-2ac83f77-d5cd-41a8-a2f5-3705fa1463ed req-d4292839-a00d-46ea-9407-1e72b8b5fcd6 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:30.700663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-2ac83f77-d5cd-41a8-a2f5-3705fa1463ed req-d4292839-a00d-46ea-9407-1e72b8b5fcd6 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:30.701095 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-2ac83f77-d5cd-41a8-a2f5-3705fa1463ed req-d4292839-a00d-46ea-9407-1e72b8b5fcd6 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:30.711894 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-2ac83f77-d5cd-41a8-a2f5-3705fa1463ed req-d4292839-a00d-46ea-9407-1e72b8b5fcd6 service nova] Creating event network-changed:7a2f96a7-b8b4-4db4-a743-a5bfa13076a5 for instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca on hv-cinder-84989 Aug 05 15:39:30.716946 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-2ac83f77-d5cd-41a8-a2f5-3705fa1463ed req-d4292839-a00d-46ea-9407-1e72b8b5fcd6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031544 Aug 05 15:39:30.717799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 408/813] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:30.775750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9bc5a4cd-92b7-4e56-aa23-cb2b327357cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:30.781051 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9bc5a4cd-92b7-4e56-aa23-cb2b327357cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:30.833391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9bc5a4cd-92b7-4e56-aa23-cb2b327357cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:30.840695 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9bc5a4cd-92b7-4e56-aa23-cb2b327357cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1087 microversion: 2.1 time: 0.068915 Aug 05 15:39:30.841266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 406/814] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:30 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:31.862665 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:31.863257 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:31.870086 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:31.870573 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:31.871012 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:31.871707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:31.872196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:31.872624 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:31.934658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:31.942140 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-53d4c859-a910-4fff-83c8-2103ee45c0cf tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1185 microversion: 2.1 time: 0.084233 Aug 05 15:39:31.942699 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 409/815] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:31 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:32.968741 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:32.969462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:32.976845 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:32.982531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:32.982531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:32.982531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:32.982531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:32.982919 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:33.123002 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:33.133718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ae151ac5-16bd-425d-8316-c120bbcae8ab tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1271 microversion: 2.1 time: 0.168755 Aug 05 15:39:33.152173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 407/816] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:32 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:33.748918 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-95dbc974-fc2d-4498-a681-a27b2c03529e req-ed6ab5b7-aeb7-4c13-8edb-7b0050cfc845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47d4294-a4d6-4950-b778-7e1947c6a8ef", "tag": "1b2ba23a-8013-4633-b805-dfe87929d3df"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:33.759251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-95dbc974-fc2d-4498-a681-a27b2c03529e req-ed6ab5b7-aeb7-4c13-8edb-7b0050cfc845 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:33.759734 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-95dbc974-fc2d-4498-a681-a27b2c03529e req-ed6ab5b7-aeb7-4c13-8edb-7b0050cfc845 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:33.760202 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-95dbc974-fc2d-4498-a681-a27b2c03529e req-ed6ab5b7-aeb7-4c13-8edb-7b0050cfc845 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:33.772048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-95dbc974-fc2d-4498-a681-a27b2c03529e req-ed6ab5b7-aeb7-4c13-8edb-7b0050cfc845 service nova] Creating event network-changed:1b2ba23a-8013-4633-b805-dfe87929d3df for instance c47d4294-a4d6-4950-b778-7e1947c6a8ef on hv-cinder-84989 Aug 05 15:39:33.776810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-95dbc974-fc2d-4498-a681-a27b2c03529e req-ed6ab5b7-aeb7-4c13-8edb-7b0050cfc845 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031631 Aug 05 15:39:33.777857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 410/817] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:34.165169 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:34.165822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:34.172470 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:34.173165 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:34.173776 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:34.174483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:34.174937 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:34.175351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:34.310875 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:34.319201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e7a72f13-c9cf-4cac-85be-18c4cf88dad1 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.158643 Aug 05 15:39:34.319784 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 408/818] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:34 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:34.806187 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1016ac5d-8365-4987-91a7-6d2fe84d9b2b", "device": "/dev/sdb"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:34.811428 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:34.815228 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:34.815704 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:34.816170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:34.817534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:34.817981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:34.818402 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:35.344640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:35.345278 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:35.352099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:35.352580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:35.353011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:35.353696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:35.354149 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:35.354571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:35.484444 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:35.492803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3cfcf35f-9468-4544-9bf9-037a315de6aa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.151139 Aug 05 15:39:35.492803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 409/819] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:35 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:39:35.694730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ad08757d-85a7-4e3a-89fb-bf6b2d7583cc tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "POST /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893865 Aug 05 15:39:35.695349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 411/820] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:39:34 2022] POST /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:39:36.512561 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:36.513170 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:36.519643 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:36.520793 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:36.521231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:36.521921 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:36.522375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:36.522811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:36.655127 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:36.657443 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=99 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:36.663848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c210aced-9bcb-48e2-b630-5ed837359c47 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.155132 Aug 05 15:39:36.667480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 410/821] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:36 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:37.686488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:37.687179 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:37.693819 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:37.694294 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:37.694726 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:37.695408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:37.695859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:37.696312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:37.829897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:37.837807 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9c0a559c-1100-4485-a1db-99aabe146052 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.156033 Aug 05 15:39:37.838367 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 412/822] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:37 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:38.858910 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:38.859552 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:38.866153 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:38.866637 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:38.867077 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:38.867768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:38.868284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:38.868715 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:39.001092 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:39.008956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f7c2e669-d87b-4573-91fb-10a76434d7a3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.154327 Aug 05 15:39:39.009514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 411/823] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:38 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:40.030234 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:40.030847 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:40.033283 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:40.034134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=6 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:40.039445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:40.039925 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:40.046136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:40.046136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:40.046136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:40.046136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:40.172111 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:40.177685 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6f5fb89d-cdc6-4143-8261-9113949449ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.151516 Aug 05 15:39:40.178251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 413/824] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:40 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:41.198216 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:41.198826 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:41.201164 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=4 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:41.205942 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:41.206421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:41.206856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:41.207541 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:41.207994 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:41.208632 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:41.339585 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:41.347107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b060ca54-c2f2-4c41-a3d1-6ef1fac25d4e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.152682 Aug 05 15:39:41.347674 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 412/825] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:41 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:42.367414 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:42.368024 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:42.374386 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:42.374859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:42.375289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:42.375968 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:42.376440 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:42.376860 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:42.379351 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:42.663899 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:42.671108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c7a9203f-c223-4324-b75e-2116f5441b50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.307581 Aug 05 15:39:42.671920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 414/826] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:42 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:43.692118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:43.692731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:43.695144 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:43.699770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:43.700460 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:43.700770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:43.707421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:43.707421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:43.707421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:43.840798 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:43.848317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ad6c425b-763f-49ae-8a41-5fdfe0ed5bfb tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.160041 Aug 05 15:39:43.848879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 413/827] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:43 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:44.870061 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:44.870675 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:44.872940 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:39:44.877597 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:44.878081 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:44.878519 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:44.879209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:44.879664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:44.880108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:45.008795 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:45.016168 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5f97c1ad-2092-4a96-8379-e7bfbb1d200b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.150949 Aug 05 15:39:45.016721 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 415/828] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:44 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:46.036970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:46.037581 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:46.044088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:46.044517 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:46.044951 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:46.045635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:46.046087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:46.046508 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:46.174689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:46.183181 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e1b12aca-b6fe-4b3e-a70e-1a974498b742 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.150136 Aug 05 15:39:46.183733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 414/829] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:46 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:47.204056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:47.204726 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:47.212135 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:47.212677 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:47.213112 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:47.213859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:47.214315 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:47.214792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:47.251916 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-b7a851a0-d1f9-4737-8fbc-e8df14c21d2a req-74b66bc5-b17f-496d-a847-7f23b990dca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47d4294-a4d6-4950-b778-7e1947c6a8ef", "name": "network-vif-plugged", "status": "completed", "tag": "1b2ba23a-8013-4633-b805-dfe87929d3df"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:47.264880 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b7a851a0-d1f9-4737-8fbc-e8df14c21d2a req-74b66bc5-b17f-496d-a847-7f23b990dca8 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:47.265360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b7a851a0-d1f9-4737-8fbc-e8df14c21d2a req-74b66bc5-b17f-496d-a847-7f23b990dca8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:47.265865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-b7a851a0-d1f9-4737-8fbc-e8df14c21d2a req-74b66bc5-b17f-496d-a847-7f23b990dca8 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:47.279462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-b7a851a0-d1f9-4737-8fbc-e8df14c21d2a req-74b66bc5-b17f-496d-a847-7f23b990dca8 service nova] Creating event network-vif-plugged:1b2ba23a-8013-4633-b805-dfe87929d3df for instance c47d4294-a4d6-4950-b778-7e1947c6a8ef on hv-cinder-84989 Aug 05 15:39:47.285298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-b7a851a0-d1f9-4737-8fbc-e8df14c21d2a req-74b66bc5-b17f-496d-a847-7f23b990dca8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036614 Aug 05 15:39:47.285936 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 415/830] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:39:47.352585 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:47.360004 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8108b699-bdd0-4a11-aa15-ef0b45cfbff7 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.160020 Aug 05 15:39:47.360592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 416/831] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:47 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:48.385310 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:48.386005 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:48.392214 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:48.392695 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:48.393124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:48.393805 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:48.394250 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:48.394667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:48.531784 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:48.539817 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ac0445ed-ed0d-44b4-91ab-9a9f7375614d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.158800 Aug 05 15:39:48.540817 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 416/832] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:48 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:49.561108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:49.561722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:49.568118 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:49.568605 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:49.569045 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:49.569759 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:49.570217 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:49.570644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:49.698289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:49.705664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-368099b0-043b-4c02-b276-a05c6a2dc8a6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.148403 Aug 05 15:39:49.706221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 417/833] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:49 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:50.727475 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:50.728110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:50.734423 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:50.734896 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:50.735329 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:50.736009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:50.736545 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:50.736965 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:51.137974 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:51.145466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e407fd0e-0ee9-430a-9157-dc536d8dd40b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.422614 Aug 05 15:39:51.146024 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 417/834] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:50 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:52.167209 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:52.167747 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:52.174299 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:52.174815 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:52.175251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:52.175943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:52.176419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:52.176843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:52.310031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:52.317822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f485f592-554b-437b-826f-a92026ae403b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1259 microversion: 2.1 time: 0.155409 Aug 05 15:39:52.318379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 418/835] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:52 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:53.339381 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:53.339993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:53.346396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:53.346867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:53.347300 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:53.348006 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:53.348474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:53.348893 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:53.478200 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:53.485788 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-12f016af-dfa8-42b0-bc2d-ea3b51dd00ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1442 microversion: 2.1 time: 0.150931 Aug 05 15:39:53.486344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 418/836] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:53 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1442 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:53.512479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:39:53.513095 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:39:53.519445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:53.519994 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:53.520468 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:53.521168 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:53.521626 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:53.522059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:53.647944 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:39:53.655623 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-989c7d06-8ce2-4cd9-95c9-a33f725b3c7e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1442 microversion: 2.1 time: 0.147217 Aug 05 15:39:53.656200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 419/837] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:39:53 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:39:55.608840 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-c85be29e-53db-46a2-bc23-f49cd52a7489 req-5bfec2c9-f82e-4905-892c-89a1956d2a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47d4294-a4d6-4950-b778-7e1947c6a8ef", "tag": "1b2ba23a-8013-4633-b805-dfe87929d3df"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:39:55.618382 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c85be29e-53db-46a2-bc23-f49cd52a7489 req-5bfec2c9-f82e-4905-892c-89a1956d2a3b service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:39:55.618855 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c85be29e-53db-46a2-bc23-f49cd52a7489 req-5bfec2c9-f82e-4905-892c-89a1956d2a3b service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:39:55.619283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c85be29e-53db-46a2-bc23-f49cd52a7489 req-5bfec2c9-f82e-4905-892c-89a1956d2a3b service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:39:55.630158 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-c85be29e-53db-46a2-bc23-f49cd52a7489 req-5bfec2c9-f82e-4905-892c-89a1956d2a3b service nova] Creating event network-changed:1b2ba23a-8013-4633-b805-dfe87929d3df for instance c47d4294-a4d6-4950-b778-7e1947c6a8ef on hv-cinder-84989 Aug 05 15:39:55.635147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-c85be29e-53db-46a2-bc23-f49cd52a7489 req-5bfec2c9-f82e-4905-892c-89a1956d2a3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029886 Aug 05 15:39:55.635746 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 419/838] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:00.410503 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:00.411023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:00.418056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:00.418543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:00.418984 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:00.419679 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:00.420158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:00.420638 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:00.503360 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lazy-loading 'services' on Instance uuid 14259f76-1a5c-4c5f-93d2-10d5b7921b19 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:40:00.702620 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e7cde234-b22f-4da4-8b04-6aa5c18093f9 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "DELETE /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19/os-volume_attachments/1016ac5d-8365-4987-91a7-6d2fe84d9b2b" status: 202 len: 0 microversion: 2.1 time: 0.295840 Aug 05 15:40:00.703185 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 420/839] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:40:00 2022] DELETE /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19/os-volume_attachments/1016ac5d-8365-4987-91a7-6d2fe84d9b2b => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:40:01.830671 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:01.831245 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:01.837327 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:01.837800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:01.838221 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:01.838901 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:01.839347 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:01.839766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:01.865031 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:40:02.119657 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1c8b959b-968e-40df-bbe2-0d7beae3b2b4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "DELETE /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 204 len: 0 microversion: 2.1 time: 0.293660 Aug 05 15:40:02.120283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 420/840] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:40:01 2022] DELETE /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:40:02.129971 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:02.131516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:02.138199 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:02.138682 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:02.139117 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:02.140088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:02.140599 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:02.141020 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:02.269957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:02.278263 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1f5b7d56-38ce-4226-9256-2d21aa774fa4 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1514 microversion: 2.1 time: 0.153163 Aug 05 15:40:02.280287 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 421/841] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:02 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:03.299458 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:03.300174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:03.307436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:03.307911 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:03.308371 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:03.309056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:03.309503 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:03.309922 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:03.439273 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:03.447432 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3392bbff-2ecf-4554-ae3c-d008db79c8f7 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1514 microversion: 2.1 time: 0.152159 Aug 05 15:40:03.447997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 421/842] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:03 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:04.469545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:04.470311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:04.479472 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:04.479961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:04.480592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:04.481509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:04.481990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:04.482416 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:04.553116 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:04.556219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-7eedff84-a769-490e-b5c9-ea5f544b74c3 req-7151622f-a420-417a-aebd-89051e621e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14259f76-1a5c-4c5f-93d2-10d5b7921b19", "name": "network-vif-deleted", "tag": "2bcc4a82-2d8e-49ad-9ec1-b159196d26b0"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:04.561494 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f6eb762d-a92a-4e36-bfaa-54638480eb3f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 200 len: 1472 microversion: 2.1 time: 0.095995 Aug 05 15:40:04.562055 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 422/843] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:04 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 1472 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:04.568870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-7eedff84-a769-490e-b5c9-ea5f544b74c3 req-7151622f-a420-417a-aebd-89051e621e9b service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:04.569350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-7eedff84-a769-490e-b5c9-ea5f544b74c3 req-7151622f-a420-417a-aebd-89051e621e9b service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:04.570339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-7eedff84-a769-490e-b5c9-ea5f544b74c3 req-7151622f-a420-417a-aebd-89051e621e9b service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:04.583619 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-7eedff84-a769-490e-b5c9-ea5f544b74c3 req-7151622f-a420-417a-aebd-89051e621e9b service nova] Creating event network-vif-deleted:2bcc4a82-2d8e-49ad-9ec1-b159196d26b0 for instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 on hv-cinder-84989 Aug 05 15:40:04.588493 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-7eedff84-a769-490e-b5c9-ea5f544b74c3 req-7151622f-a420-417a-aebd-89051e621e9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036284 Aug 05 15:40:04.589147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 422/844] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:05.582802 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:05.583407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 14259f76-1a5c-4c5f-93d2-10d5b7921b19] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:05.592459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:05.592459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:05.592459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:05.593126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:05.593567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:05.593988 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:05.608306 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] HTTP exception thrown: Instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 could not be found. Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Request method failure captured: Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 HTTP/1.1 Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TmQyLn0EZNvoXvp3n8FF12SV8X2v9Gm-OdijtgqiajjoW8r4hXFo4BFJ69t4BgmVlKUEDiAcQexgbyKat95TYMDzp_iqNQ1f-hYp3evgGVfMjRPUm_hwM-FITsPPFSK2n-rvGjej6jlFhe956ugJbhO3Lr7I0aRGvd9I_XomVtlfr8 Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 39c62721dfdd46e3978fccce91b63791 Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1263849729 Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:40:05.610057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_39c62721dfdd46e3978fccce91b63791", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39c62721dfdd46e3978fccce91b63791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39c62721dfdd46e3978fccce91b63791"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/39c62721dfdd46e3978fccce91b63791"}]}] Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-VolumesSnapshotTestJSON-1263849729 Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 39c62721dfdd46e3978fccce91b63791 Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1263849729 Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-VolumesSnapshotTestJSON-1263849729-project Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 8cfb345e7c044b669ec6c4a6a79a28ee Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-VolumesSnapshotTestJSON-1263849729-project Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 could not be found. Aug 05 15:40:05.611834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '14259f76-1a5c-4c5f-93d2-10d5b7921b19'} Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 could not be found. Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:05.612884 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 could not be found. Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 could not be found. Aug 05 15:40:05.614543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:05.615941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Returning 404 to user: Instance 14259f76-1a5c-4c5f-93d2-10d5b7921b19 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:05.615941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-89da9d97-0223-4b42-9537-5c1d35dd255e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19" status: 404 len: 111 microversion: 2.1 time: 0.032644 Aug 05 15:40:05.615941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 423/845] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:05 2022] GET /compute/v2.1/servers/14259f76-1a5c-4c5f-93d2-10d5b7921b19 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:40:16.062645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:16.063391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:16.067383 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1495997354", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "networks": [{"uuid": "d38f37ed-3cc5-47f6-8fc2-0e6649cca615"}]}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:16.119317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] validate_networks() for [('d38f37ed-3cc5-47f6-8fc2-0e6649cca615', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:40:16.460499 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:40:16.461001 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:40:16.461474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:40:16.461882 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:40:16.462292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:40:16.471129 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:16.472838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:16.472838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:16.473519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:16.473972 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:16.474396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:16.494385 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Getting quotas for project 39c62721dfdd46e3978fccce91b63791. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:40:16.497049 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Getting quotas for user 8cfb345e7c044b669ec6c4a6a79a28ee and project 39c62721dfdd46e3978fccce91b63791. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:40:16.508407 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:40:16.510688 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:40:16.641970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-95dbd813-60ab-46a3-8204-0b698adfea57 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580761 Aug 05 15:40:16.642668 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 423/846] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:40:16.653770 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8cc95f21-3d8e-42b0-aeea-5c975f5bd2e8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:16.654388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8cc95f21-3d8e-42b0-aeea-5c975f5bd2e8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:16.656670 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=17 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:16.658490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:16.709661 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8cc95f21-3d8e-42b0-aeea-5c975f5bd2e8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:16.716498 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8cc95f21-3d8e-42b0-aeea-5c975f5bd2e8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1219 microversion: 2.1 time: 0.066769 Aug 05 15:40:16.717058 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 424/847] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:16 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:17.526872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:17.527461 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:17.534347 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.534905 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.535308 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.536005 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.536480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.542436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.563409 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1fecd0d8-e9ea-4c47-8443-c9e36a0df9a2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca/ips" status: 200 len: 149 microversion: 2.1 time: 0.038280 Aug 05 15:40:17.563409 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 424/848] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:40:17 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:17.573631 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d41c844e-3410-4ddf-a69b-9d929c8052fb"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:17.576156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:17.583449 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.583922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.584376 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.585587 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.586038 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.586455 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.677961 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Invalid volume: volume d41c844e-3410-4ddf-a69b-9d929c8052fb is already attached to instances: 5f435a35-7760-4b03-8d2e-6f40df5f5714 Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: POST /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca/os-volume_attachments HTTP/1.1 Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 74 Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:40:17.679627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {"volumeAttachment": {"volumeId": "d41c844e-3410-4ddf-a69b-9d929c8052fb"}} Aug 05 15:40:17.681252 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Invalid volume: volume d41c844e-3410-4ddf-a69b-9d929c8052fb is already attached to instances: 5f435a35-7760-4b03-8d2e-6f40df5f5714 Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'server_id': '59fb549a-27e1-4a42-b47c-1f04bd4d23ca', 'body': {'volumeAttachment': {'volumeId': 'd41c844e-3410-4ddf-a69b-9d929c8052fb'}}} Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d41c844e-3410-4ddf-a69b-9d929c8052fb is already attached to instances: 5f435a35-7760-4b03-8d2e-6f40df5f5714 Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:17.682071 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d41c844e-3410-4ddf-a69b-9d929c8052fb is already attached to instances: 5f435a35-7760-4b03-8d2e-6f40df5f5714 Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:17.683370 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:17.684792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:17.684792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:17.684792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:17.684792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d41c844e-3410-4ddf-a69b-9d929c8052fb is already attached to instances: 5f435a35-7760-4b03-8d2e-6f40df5f5714 Aug 05 15:40:17.684792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:17.684792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 400 to user: Invalid volume: volume d41c844e-3410-4ddf-a69b-9d929c8052fb is already attached to instances: 5f435a35-7760-4b03-8d2e-6f40df5f5714 {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:17.684792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f1ec9715-5821-4c36-90f9-59058d91f62c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111679 Aug 05 15:40:17.684792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 425/849] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:40:17 2022] POST /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:40:17.691770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:17.692323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:17.698778 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.699261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.699699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.700422 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.700955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.701383 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.726185 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:40:17.738116 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:17.738920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:17.745481 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.745982 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.746453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.747151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.747610 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.748035 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.810904 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:17.818450 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-46a12295-49eb-45fe-8c46-cca0ecacb44e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1223 microversion: 2.1 time: 0.084270 Aug 05 15:40:17.819003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 426/850] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:17 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:40:17.976600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1ae4dd81-54e6-47c5-aced-cad51707304c tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 204 len: 0 microversion: 2.1 time: 0.287741 Aug 05 15:40:17.977293 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 425/851] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:40:17 2022] DELETE /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:40:17.985508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:17.986265 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:17.992738 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.993214 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.993647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:17.994356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:17.994804 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:17.995231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:18.126588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:18.134014 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0d14841e-4822-4eb4-a499-134bb19bff06 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1680 microversion: 2.1 time: 0.152384 Aug 05 15:40:18.134588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 427/852] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:17 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:18.843978 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:18.844712 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:18.850996 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:18.851511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:18.851951 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:18.852668 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:18.853122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:18.853557 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:18.914843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:18.922189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e22c6c3e-8964-473e-8855-21cfc6bdfbad tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1271 microversion: 2.1 time: 0.082568 Aug 05 15:40:18.922752 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 426/853] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:18 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:19.155745 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:19.156373 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:19.162746 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:19.163856 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:19.164324 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:19.165026 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:19.165485 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:19.165911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:19.309036 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:19.316412 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-72021607-2eb8-48e6-94f8-eebebbe9b962 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1680 microversion: 2.1 time: 0.164848 Aug 05 15:40:19.316965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 428/854] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:19 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:19.942812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:19.943350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:19.949736 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:19.950216 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:19.950643 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:19.951335 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:19.951810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:19.952222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:20.015933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:20.023569 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a807420a-d189-4edd-bf74-1971b04fec58 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1271 microversion: 2.1 time: 0.084627 Aug 05 15:40:20.029061 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 427/855] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:19 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:20.338364 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:20.339049 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:20.345400 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:20.345977 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:20.346547 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:20.347303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:20.347836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:20.348354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:20.568795 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:20.578783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4a9dd509-26c0-40bf-8510-9b62c752c2b8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1680 microversion: 2.1 time: 0.244532 Aug 05 15:40:20.579439 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 429/856] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:20 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:20.881566 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-3cfb5a36-fd36-4842-8401-5c22b1ec235d req-58b70ec1-bffc-486b-8a46-0379bf9a4b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fb549a-27e1-4a42-b47c-1f04bd4d23ca", "name": "network-vif-deleted", "tag": "7a2f96a7-b8b4-4db4-a743-a5bfa13076a5"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:20.891084 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-3cfb5a36-fd36-4842-8401-5c22b1ec235d req-58b70ec1-bffc-486b-8a46-0379bf9a4b1a service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:20.892441 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-3cfb5a36-fd36-4842-8401-5c22b1ec235d req-58b70ec1-bffc-486b-8a46-0379bf9a4b1a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:20.892441 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-3cfb5a36-fd36-4842-8401-5c22b1ec235d req-58b70ec1-bffc-486b-8a46-0379bf9a4b1a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:20.914860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-3cfb5a36-fd36-4842-8401-5c22b1ec235d req-58b70ec1-bffc-486b-8a46-0379bf9a4b1a service nova] Creating event network-vif-deleted:7a2f96a7-b8b4-4db4-a743-a5bfa13076a5 for instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca on hv-cinder-84989 Aug 05 15:40:20.920444 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-3cfb5a36-fd36-4842-8401-5c22b1ec235d req-58b70ec1-bffc-486b-8a46-0379bf9a4b1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042414 Aug 05 15:40:20.921800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 428/857] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:21.045588 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:21.046251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:21.052892 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:21.053391 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:21.054084 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:21.054844 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:21.055497 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:21.055944 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:21.323204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:21.331609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f15f9c03-9e51-44c7-819f-84f093cedd2f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.290044 Aug 05 15:40:21.333245 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 430/858] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:21 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:21.601251 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:21.601934 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:21.608508 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:21.609038 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:21.609491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:21.610158 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:21.610607 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:21.611024 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:21.642730 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:21.643209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:21.643645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:21.644123 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lazy-loading 'fault' on Instance uuid 59fb549a-27e1-4a42-b47c-1f04bd4d23ca {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:40:21.718596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:21.727633 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a488480b-bac3-4fda-b9ae-6a3dd4b6d317 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 200 len: 1332 microversion: 2.1 time: 0.130532 Aug 05 15:40:21.736207 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 429/859] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:21 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:21.961400 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-c48555b1-8006-4e51-a482-16d2c1df9971 req-45161b6e-ce9c-41f6-a87d-c2db19d1ed29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde", "tag": "0963283c-b392-4f5e-b5f4-4ffe8b59f44d"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:21.971901 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c48555b1-8006-4e51-a482-16d2c1df9971 req-45161b6e-ce9c-41f6-a87d-c2db19d1ed29 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:21.979171 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c48555b1-8006-4e51-a482-16d2c1df9971 req-45161b6e-ce9c-41f6-a87d-c2db19d1ed29 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:21.979171 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-c48555b1-8006-4e51-a482-16d2c1df9971 req-45161b6e-ce9c-41f6-a87d-c2db19d1ed29 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:21.990970 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-c48555b1-8006-4e51-a482-16d2c1df9971 req-45161b6e-ce9c-41f6-a87d-c2db19d1ed29 service nova] Creating event network-changed:0963283c-b392-4f5e-b5f4-4ffe8b59f44d for instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde on hv-cinder-84989 Aug 05 15:40:21.997151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-c48555b1-8006-4e51-a482-16d2c1df9971 req-45161b6e-ce9c-41f6-a87d-c2db19d1ed29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039874 Aug 05 15:40:21.998233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 431/860] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:22.353687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:22.354287 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:22.360428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:22.360956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:22.361385 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:22.362066 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:22.362532 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:22.362953 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:22.560294 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:22.567530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-09a6f66a-ebf8-48b2-9395-f82244f74e34 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.218111 Aug 05 15:40:22.568111 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 430/861] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:22 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:22.749869 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:22.750472 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:22.756898 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:22.757386 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:22.757821 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:22.758525 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:22.758997 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:22.759404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:22.774017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca HTTP/1.1 Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:40:22.775686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:40:22.777359 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '59fb549a-27e1-4a42-b47c-1f04bd4d23ca'} Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:22.778317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:40:22.780056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:22.781452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:22.781452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-89a3dd0f-a2b4-4a3d-8625-7a7fc61b96e1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 404 len: 111 microversion: 2.1 time: 0.031699 Aug 05 15:40:22.781636 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 432/862] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:22 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:40:22.786517 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b662d7d2-26a0-4fd4-ba7e-a02f2a456353 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '.version_select at 0x7fcb14cf0040>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:22.864367 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b662d7d2-26a0-4fd4-ba7e-a02f2a456353 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762313945" status: 202 len: 0 microversion: 2.1 time: 0.081585 Aug 05 15:40:22.864943 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 431/863] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 5 15:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762313945 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:40:23.588087 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:23.588854 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:23.596591 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:23.597076 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:23.597519 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:23.598221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:23.598681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:23.599131 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:23.650533 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:23.651020 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:23.657091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:23.657565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:23.657995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:23.658685 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:23.659129 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:23.659543 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:23.730994 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:23.738609 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f1370c89-0a26-4f67-953c-9385b5994acd tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.154457 Aug 05 15:40:23.739319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 433/864] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:23 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:23.743221 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lazy-loading 'services' on Instance uuid 5f435a35-7760-4b03-8d2e-6f40df5f5714 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:40:23.919261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e5888b75-50a8-4433-a81f-085c43904ef7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-volume_attachments/d41c844e-3410-4ddf-a69b-9d929c8052fb" status: 202 len: 0 microversion: 2.1 time: 0.272545 Aug 05 15:40:23.919886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 432/865] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:40:23 2022] DELETE /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-volume_attachments/d41c844e-3410-4ddf-a69b-9d929c8052fb => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 15:40:23.928269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:23.930466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:23.936576 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:23.937056 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:23.937493 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:23.938193 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:23.938656 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:23.939084 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:23.968759 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-82f28201-d369-4348-8bb6-1e0f76ecb625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Aug 05 15:40:23.969317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 434/866] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:40:23 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:24.760451 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:24.761141 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:24.767442 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:24.773057 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:24.773057 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:24.773057 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:24.773057 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:24.773459 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:24.905470 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:24.913169 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-81bf640f-b0d1-45c5-b550-04f0d6595b04 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.156947 Aug 05 15:40:24.914280 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 433/867] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:24 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:24.981197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:24.983341 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:24.989695 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:24.990178 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:24.990618 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:24.991319 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:24.991779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:24.992241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:25.019644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5100315c-09f9-484d-9358-06560e38378e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042521 Aug 05 15:40:25.020204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 435/868] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:40:24 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 15:40:25.080436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:25.080921 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:25.087209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:25.087686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:25.088143 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:25.088828 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:25.089274 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:25.089693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:25.113863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:40:25.392783 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2ca42909-4006-4fc3-8a92-344ce183ef3b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 204 len: 0 microversion: 2.1 time: 0.315716 Aug 05 15:40:25.393320 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 434/869] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:40:25 2022] DELETE /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:40:25.407870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:25.408505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:25.414615 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:25.415101 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:25.415539 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:25.416267 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:25.416722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:25.417151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:25.541901 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:25.549330 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e347c86f-9cf9-4b91-84da-feeb12de5ad5 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1679 microversion: 2.1 time: 0.145583 Aug 05 15:40:25.549885 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 436/870] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:25 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:25.935781 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:25.936509 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:25.950361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:25.950849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:25.951292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:25.951987 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:25.952473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:25.952899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:26.082679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:26.090094 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1c6bf416-8cd5-4a96-8327-999303490865 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.159263 Aug 05 15:40:26.090660 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 435/871] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:25 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:26.570903 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:26.571521 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:26.577983 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:26.578466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:26.578905 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:26.579602 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:26.580059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:26.580513 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:26.709662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:26.713830 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:26.718334 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6a5e9fdf-1af9-4cdf-acad-5ce9a9faeb65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1679 microversion: 2.1 time: 0.151341 Aug 05 15:40:26.718895 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 437/872] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:26 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:27.111651 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:27.112303 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:27.114239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:27.114898 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=6 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:27.120012 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:27.120522 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:27.120957 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:27.121642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:27.122095 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:27.122515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:27.324419 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:27.331779 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-eec091a6-2df2-43fb-b465-785c44d4abce tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.224244 Aug 05 15:40:27.332381 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 436/873] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:27 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:27.740325 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:27.740934 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:27.747792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:27.748310 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:27.748751 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:27.749453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:27.749911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:27.750340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:27.996783 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:28.004940 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4a7ede1e-9124-4a5d-81df-0fa3340a3cc0 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1679 microversion: 2.1 time: 0.268521 Aug 05 15:40:28.007948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 438/874] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:27 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1679 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:28.178099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-6d9bf72a-5c34-4b87-ab09-12a84076fe1d req-cf2b8478-435c-4ea3-84ee-85187d92219f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f435a35-7760-4b03-8d2e-6f40df5f5714", "name": "network-vif-deleted", "tag": "fe6362dc-a493-493c-b74d-993dbc8bfad2"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:28.189303 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6d9bf72a-5c34-4b87-ab09-12a84076fe1d req-cf2b8478-435c-4ea3-84ee-85187d92219f service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:28.190874 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6d9bf72a-5c34-4b87-ab09-12a84076fe1d req-cf2b8478-435c-4ea3-84ee-85187d92219f service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:28.190874 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-6d9bf72a-5c34-4b87-ab09-12a84076fe1d req-cf2b8478-435c-4ea3-84ee-85187d92219f service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:28.206855 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-6d9bf72a-5c34-4b87-ab09-12a84076fe1d req-cf2b8478-435c-4ea3-84ee-85187d92219f service nova] Creating event network-vif-deleted:fe6362dc-a493-493c-b74d-993dbc8bfad2 for instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 on hv-cinder-84989 Aug 05 15:40:28.213079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-6d9bf72a-5c34-4b87-ab09-12a84076fe1d req-cf2b8478-435c-4ea3-84ee-85187d92219f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042687 Aug 05 15:40:28.213836 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 437/875] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:28.354089 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:28.354862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:28.361125 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:28.361757 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:28.362303 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:28.363114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:28.363754 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:28.364486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:28.497373 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:28.504888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-d0fd43ac-bef9-4e56-9014-38db31a86361 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.155682 Aug 05 15:40:28.505440 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 439/876] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:28 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:29.035246 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:29.035936 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:29.042014 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:29.042491 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:29.042921 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:29.043678 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:29.044055 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:29.044498 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:29.062702 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:29.075994 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:29.076506 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:29.076933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:29.077373 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lazy-loading 'fault' on Instance uuid 5f435a35-7760-4b03-8d2e-6f40df5f5714 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:40:29.119723 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:29.127499 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-59ade334-a1b9-4264-a437-aeb174fc68fe tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 200 len: 1330 microversion: 2.1 time: 0.096498 Aug 05 15:40:29.128101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 438/877] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:29 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:29.526521 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:29.527208 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:29.530248 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-f0781610-5aa2-49c3-abf5-d2b953634879 req-f6f1f7ee-de5f-4885-9318-43917088e07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde", "name": "network-vif-plugged", "status": "completed", "tag": "0963283c-b392-4f5e-b5f4-4ffe8b59f44d"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:29.534052 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:29.534554 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:29.534976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:29.535681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:29.536157 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:29.536585 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:29.541880 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f0781610-5aa2-49c3-abf5-d2b953634879 req-f6f1f7ee-de5f-4885-9318-43917088e07e service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:29.546009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f0781610-5aa2-49c3-abf5-d2b953634879 req-f6f1f7ee-de5f-4885-9318-43917088e07e service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:29.546009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-f0781610-5aa2-49c3-abf5-d2b953634879 req-f6f1f7ee-de5f-4885-9318-43917088e07e service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:29.553616 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-f0781610-5aa2-49c3-abf5-d2b953634879 req-f6f1f7ee-de5f-4885-9318-43917088e07e service nova] Creating event network-vif-plugged:0963283c-b392-4f5e-b5f4-4ffe8b59f44d for instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde on hv-cinder-84989 Aug 05 15:40:29.559002 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-f0781610-5aa2-49c3-abf5-d2b953634879 req-f6f1f7ee-de5f-4885-9318-43917088e07e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033175 Aug 05 15:40:29.559580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 439/878] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:29.676407 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:29.684942 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-393dca04-e723-4efe-bdf9-c8df7bcc3f4e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.162524 Aug 05 15:40:29.686818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 440/879] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:29 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:30.152305 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:30.152959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:30.159659 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:30.160165 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:30.160605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:30.161298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:30.161799 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:30.162222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:30.176167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 HTTP/1.1 Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:40:30.177821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:40:30.179627 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '5f435a35-7760-4b03-8d2e-6f40df5f5714'} Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:30.180575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:40:30.182156 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:30.183843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:30.183843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2902b6bb-905c-432a-bb6b-5d86053a1f70 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 404 len: 111 microversion: 2.1 time: 0.032166 Aug 05 15:40:30.183843 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 440/880] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:30 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:40:30.188084 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1964116c-b504-4e0b-9b79-c846d3c542d9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '.version_select at 0x7fcb14d65af0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:30.256932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1964116c-b504-4e0b-9b79-c846d3c542d9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640941642" status: 202 len: 0 microversion: 2.1 time: 0.072724 Aug 05 15:40:30.257492 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 441/881] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 15:40:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640941642 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:40:30.705754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:30.706370 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:30.713949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:30.714462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:30.714904 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:30.715598 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:30.716058 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:30.716749 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:30.911466 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:30.919065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c5dbf28f-a308-4539-bfde-246c0ebb1aa8 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1319 microversion: 2.1 time: 0.217486 Aug 05 15:40:30.919800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 441/882] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:30 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:40:31.128996 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9b8dba33-e9f8-4c6b-ab0b-219511abc1dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: .version_select at 0x7fcb14dcdb80>, body: {"keypair": {"name": "tempest-keypair-687114848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4ZZauKOKBx8OlSTBa0xW+MBUCZm4sRh+oar+CMH4M9kSeRwZ7STPxbWI/DbTDQCDPWD2Lyr+ciPocc4rXR4mXRWdmlNLC2nsK0m2aOpDC4NC2XMbOTgs33UtK7uogvig=="}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:31.145123 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-9b8dba33-e9f8-4c6b-ab0b-219511abc1dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for project 2c77da48edba4903a1c51fee2a856167. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:40:31.148922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-9b8dba33-e9f8-4c6b-ab0b-219511abc1dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for user dd5c43d63a754eeaaba429f5c8153bba and project 2c77da48edba4903a1c51fee2a856167. Resources: {'key_pairs'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:40:31.240352 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9b8dba33-e9f8-4c6b-ab0b-219511abc1dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115654 Aug 05 15:40:31.240969 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 442/883] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:40:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:31.940539 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:31.941150 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:31.948154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:31.949211 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:31.949211 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:31.949736 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:31.950208 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:31.950621 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:32.080603 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:32.088703 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4564e432-7cb8-4649-a163-b15537220dec tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1509 microversion: 2.1 time: 0.152254 Aug 05 15:40:32.089407 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 442/884] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:31 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:32.109558 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e01d6ec9-9749-46cb-afd8-2c1af6214b60", "device": "/dev/sdb"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:32.111958 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:32.117839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:32.119867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:32.119867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:32.119867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:32.120232 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:32.120364 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:32.661532 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:32.786178 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-405f6dab-98de-4f1c-80c0-da8749e8d68e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "POST /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680579 Aug 05 15:40:32.786899 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 443/885] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:40:32 2022] POST /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:33.245831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1647097256", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b05605aa-dd0e-428b-8865-2528537f12f7"}], "security_groups": [{"name": "tempest-securitygroup--359906889"}], "key_name": "tempest-keypair-687114848", "user_data": "}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:33.383309 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] validate_networks() for [('b05605aa-dd0e-428b-8865-2528537f12f7', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:40:34.331686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:40:34.332227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:40:34.332584 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:40:34.332988 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:40:34.333396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:40:34.342912 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:34.353205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:34.353679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:34.354467 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:34.354924 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:34.355346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:34.374410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for project 2c77da48edba4903a1c51fee2a856167. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:40:34.380368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for user dd5c43d63a754eeaaba429f5c8153bba and project 2c77da48edba4903a1c51fee2a856167. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:40:34.381101 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:34.381681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:34.390688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:34.391256 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:34.391621 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:34.392522 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:34.392975 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:34.393350 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:40:34.394079 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:34.395818 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:40:34.419744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Going to try to terminate instance {{(pid=118723) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:40:34.539891 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8ed77efb-db24-41ef-b5c6-a680940ae2f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.298978 Aug 05 15:40:34.546556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 443/886] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:40:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:40:34.546556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-638c744c-037b-4fd6-803d-cab62b94af9e req-b8005e43-4ed5-4ec9-968d-624e4af0d686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d75ad1-7ef8-42aa-b898-36ff34c67162", "tag": "bedd8c00-a5cc-4970-b3d9-dab948345d16"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:34.556057 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-638c744c-037b-4fd6-803d-cab62b94af9e req-b8005e43-4ed5-4ec9-968d-624e4af0d686 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:34.557570 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-638c744c-037b-4fd6-803d-cab62b94af9e req-b8005e43-4ed5-4ec9-968d-624e4af0d686 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:34.557570 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-638c744c-037b-4fd6-803d-cab62b94af9e req-b8005e43-4ed5-4ec9-968d-624e4af0d686 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:34.582935 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-638c744c-037b-4fd6-803d-cab62b94af9e req-b8005e43-4ed5-4ec9-968d-624e4af0d686 service nova] Creating event network-changed:bedd8c00-a5cc-4970-b3d9-dab948345d16 for instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 on hv-cinder-84989 Aug 05 15:40:34.588340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-638c744c-037b-4fd6-803d-cab62b94af9e req-b8005e43-4ed5-4ec9-968d-624e4af0d686 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045904 Aug 05 15:40:34.589636 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 444/887] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:34.596340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8136ca5b-197e-476d-8f0a-c7e338d5b538 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:34.602378 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8136ca5b-197e-476d-8f0a-c7e338d5b538 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:34.671394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-35494bef-89e5-4b69-81b1-c0035a643041 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 204 len: 0 microversion: 2.1 time: 0.294627 Aug 05 15:40:34.675733 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 444/888] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:40:34 2022] DELETE /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:40:34.684646 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8136ca5b-197e-476d-8f0a-c7e338d5b538 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:34.687067 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:34.691754 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:34.701745 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8136ca5b-197e-476d-8f0a-c7e338d5b538 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1241 microversion: 2.1 time: 0.110538 Aug 05 15:40:34.703393 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 445/889] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:34 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:34.709387 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:34.709643 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:34.710083 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:34.710926 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:34.711282 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:34.711733 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:34.893373 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:34.901503 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7456336f-0420-4bda-8516-b6eb1baef592 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1578 microversion: 2.1 time: 0.219786 Aug 05 15:40:34.904980 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 445/890] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:34 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:40:35.724009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:35.724564 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:35.731222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:35.731693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:35.732160 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:35.732839 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:35.733284 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:35.733733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:35.798536 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:35.805859 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9d4dab54-020c-48e9-80bb-9442bec1131d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1245 microversion: 2.1 time: 0.085845 Aug 05 15:40:35.806403 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 446/891] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:35 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:35.924681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:35.925289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:35.931817 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:35.932324 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:35.932764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:35.933457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:35.933906 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:35.934326 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:36.109459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:36.116524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ef217112-2321-4b39-9b83-c92a3c19ce8e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1578 microversion: 2.1 time: 0.195697 Aug 05 15:40:36.117824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 446/892] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:35 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:36.826808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:36.827470 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:36.831239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:36.834849 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:36.839201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:36.839201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:36.839201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:36.839201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:36.839812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:36.924769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:36.937213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-43dfe40f-3065-4394-9ab4-70f1ac4dea1d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1301 microversion: 2.1 time: 0.113838 Aug 05 15:40:36.944221 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 447/893] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:36 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1301 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:37.121183 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-a73cecf5-1087-4ecb-8e09-5d6cfe60ec25 req-9a244e0d-78b5-4b2f-b393-023f4084f5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d75ad1-7ef8-42aa-b898-36ff34c67162", "name": "network-vif-deleted", "tag": "bedd8c00-a5cc-4970-b3d9-dab948345d16"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:37.134987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a73cecf5-1087-4ecb-8e09-5d6cfe60ec25 req-9a244e0d-78b5-4b2f-b393-023f4084f5e9 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:37.135481 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a73cecf5-1087-4ecb-8e09-5d6cfe60ec25 req-9a244e0d-78b5-4b2f-b393-023f4084f5e9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:37.135911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-a73cecf5-1087-4ecb-8e09-5d6cfe60ec25 req-9a244e0d-78b5-4b2f-b393-023f4084f5e9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:37.138883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:37.139499 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:37.145943 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:37.146421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:37.152025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:37.164028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-a73cecf5-1087-4ecb-8e09-5d6cfe60ec25 req-9a244e0d-78b5-4b2f-b393-023f4084f5e9 service nova] Creating event network-vif-deleted:bedd8c00-a5cc-4970-b3d9-dab948345d16 for instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 on hv-cinder-84989 Aug 05 15:40:37.164337 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:37.164337 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:37.164337 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:37.164931 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-a73cecf5-1087-4ecb-8e09-5d6cfe60ec25 req-9a244e0d-78b5-4b2f-b393-023f4084f5e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040806 Aug 05 15:40:37.164931 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 447/894] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:37.227429 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:37.235310 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f0607341-3eda-4631-97d1-4a65391caa29 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1391 microversion: 2.1 time: 0.100565 Aug 05 15:40:37.235953 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 448/895] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:37 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1391 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:40:37.961229 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:37.961922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:37.968045 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:37.974758 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:37.974758 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:37.974758 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:37.974758 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:37.975217 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:38.159032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:38.173357 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3737bbe5-6ae2-479c-9484-4a6fe380abc2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.216295 Aug 05 15:40:38.174141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 448/896] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:37 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:38.257740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:38.259260 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:38.266398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:38.266889 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:38.267310 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:38.268381 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:38.268823 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:38.270237 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:38.304413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:38.304812 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:38.305257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:38.305709 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lazy-loading 'fault' on Instance uuid b7d75ad1-7ef8-42aa-b898-36ff34c67162 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:40:38.363765 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:38.370751 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8a23356f-93b9-41c7-904b-23bc320119f3 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 200 len: 1184 microversion: 2.1 time: 0.117693 Aug 05 15:40:38.371515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 449/897] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:38 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 1184 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:38.839640 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-3072ec07-a7e4-4192-921e-37291c601e00 req-8cdfbb99-49f5-49be-a356-d7ac2f48503a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98fdfc63-b5ab-461d-a014-ea82d1d65b0b", "tag": "9a390035-5da3-4925-af6e-1b9b968c2cb4"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:38.848848 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-3072ec07-a7e4-4192-921e-37291c601e00 req-8cdfbb99-49f5-49be-a356-d7ac2f48503a service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:38.849341 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-3072ec07-a7e4-4192-921e-37291c601e00 req-8cdfbb99-49f5-49be-a356-d7ac2f48503a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:38.849762 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-3072ec07-a7e4-4192-921e-37291c601e00 req-8cdfbb99-49f5-49be-a356-d7ac2f48503a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:38.860661 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-3072ec07-a7e4-4192-921e-37291c601e00 req-8cdfbb99-49f5-49be-a356-d7ac2f48503a service nova] Creating event network-changed:9a390035-5da3-4925-af6e-1b9b968c2cb4 for instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b on hv-cinder-84989 Aug 05 15:40:38.865391 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-3072ec07-a7e4-4192-921e-37291c601e00 req-8cdfbb99-49f5-49be-a356-d7ac2f48503a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030189 Aug 05 15:40:38.865979 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 449/898] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:40:39.194856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:39.196258 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:39.202241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:39.202721 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:39.203152 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:39.203860 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:39.204332 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:39.204749 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:39.330958 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:39.338287 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-49875d55-d38d-48d5-89e7-f8c8c532d083 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.147405 Aug 05 15:40:39.338841 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 450/899] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:39 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:39.392408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:39.393111 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: b7d75ad1-7ef8-42aa-b898-36ff34c67162] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:39.399284 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:39.399769 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:39.400237 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:39.400941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:39.401397 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:39.401824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:39.415821 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] HTTP exception thrown: Instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 could not be found. Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Request method failure captured: Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 HTTP/1.1 Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TggOUGASJ2xEeUWjiMlZQ8nvKC4dC76mMYmGiEGTuyEluIIWhFQ2bBA_wOrHpPW89KmGTXHKIDjw0oUcRfXNmMKZV_WnvYjIhO8o8Cf-OTNLHz0FjXR4E7ZzuaVbIaHmHQ5INfr5ubNYIOWIHOjxMRUnihxnbqM4bbUzX0RllJWv74 Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:40:39.417507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99b26247f85d45c0a7c1e763758f2e69", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99b26247f85d45c0a7c1e763758f2e69"}]}] Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 1782b4e84c9f484297e17c248738105c Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 could not be found. Aug 05 15:40:39.419201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': 'b7d75ad1-7ef8-42aa-b898-36ff34c67162'} Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 could not be found. Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:39.420091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 could not be found. Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 could not be found. Aug 05 15:40:39.421662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:39.423317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Returning 404 to user: Instance b7d75ad1-7ef8-42aa-b898-36ff34c67162 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:39.423317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e26e239a-217c-4f3b-94aa-94be25bf550d tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162" status: 404 len: 111 microversion: 2.1 time: 0.031309 Aug 05 15:40:39.423317 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 450/900] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:39 2022] GET /compute/v2.1/servers/b7d75ad1-7ef8-42aa-b898-36ff34c67162 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:40:40.358870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:40.362971 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:40.366192 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:40.366675 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:40.367108 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:40.367805 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:40.368299 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:40.368724 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:40.502879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:40.510912 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-25319fca-e372-4eed-9d89-67fadd3a8fb6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.155945 Aug 05 15:40:40.511468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 451/901] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:40 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:41.532865 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:41.533534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:41.535945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=4 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:41.541326 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:41.541805 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:41.542238 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:41.542924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:41.543371 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:41.543791 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:41.677375 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:41.685517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-91f029b7-d548-42a1-af64-8c4b11c4dc9d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.156741 Aug 05 15:40:41.686167 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 451/902] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:41 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:42.706710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:42.707342 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:42.714516 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:42.714996 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:42.715425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:42.716163 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:42.716608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:42.717027 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:42.844310 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:42.851547 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9fde26f3-7634-4b88-849d-b0c0e4042659 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.148741 Aug 05 15:40:42.852117 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 452/903] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:42 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:43.877204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:43.877204 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:43.882477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:43.883465 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:43.883963 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:43.884690 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:43.885139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:43.885561 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:44.025101 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:44.025666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0254d230-43c9-41b3-a1b1-49df49194f61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.156912 Aug 05 15:40:44.026233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 452/904] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:43 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:40:45.046518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:45.047122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:45.049818 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:45.050506 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=8 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:45.055241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:45.055720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:45.061087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:45.061087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:45.061087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:45.061087 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:45.203609 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:45.211847 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-75eb0661-495d-4d33-9bfb-6c18472800d1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.168575 Aug 05 15:40:45.212457 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 453/905] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:45 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:45.655346 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-611c0ed0-adfb-446d-9ff4-c0e35388b745 req-43fa6bd6-00cc-4076-bf52-c116b72f2109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fdfc63-b5ab-461d-a014-ea82d1d65b0b", "name": "network-vif-plugged", "status": "completed", "tag": "9a390035-5da3-4925-af6e-1b9b968c2cb4"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:45.668764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-611c0ed0-adfb-446d-9ff4-c0e35388b745 req-43fa6bd6-00cc-4076-bf52-c116b72f2109 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:45.668764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-611c0ed0-adfb-446d-9ff4-c0e35388b745 req-43fa6bd6-00cc-4076-bf52-c116b72f2109 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:45.668764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-611c0ed0-adfb-446d-9ff4-c0e35388b745 req-43fa6bd6-00cc-4076-bf52-c116b72f2109 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:45.682756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-611c0ed0-adfb-446d-9ff4-c0e35388b745 req-43fa6bd6-00cc-4076-bf52-c116b72f2109 service nova] Creating event network-vif-plugged:9a390035-5da3-4925-af6e-1b9b968c2cb4 for instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b on hv-cinder-84989 Aug 05 15:40:45.687554 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-611c0ed0-adfb-446d-9ff4-c0e35388b745 req-43fa6bd6-00cc-4076-bf52-c116b72f2109 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036297 Aug 05 15:40:45.688176 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 453/906] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:45.990634 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:45.991133 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:45.999017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:45.999495 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:45.999927 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:46.000645 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:46.001099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:46.001521 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:46.008591 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-725810e1-0882-409e-b461-4dab815647c8 req-43038ec0-7b29-488c-ae0f-ec0c2cc1ad49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06b5eb5-e324-4e7d-a084-27a8344c861b", "tag": "8f81a0ab-db08-458a-a907-344e54cc9456"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:46.017958 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-725810e1-0882-409e-b461-4dab815647c8 req-43038ec0-7b29-488c-ae0f-ec0c2cc1ad49 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:46.018439 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-725810e1-0882-409e-b461-4dab815647c8 req-43038ec0-7b29-488c-ae0f-ec0c2cc1ad49 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:46.018876 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-725810e1-0882-409e-b461-4dab815647c8 req-43038ec0-7b29-488c-ae0f-ec0c2cc1ad49 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:46.033075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-725810e1-0882-409e-b461-4dab815647c8 req-43038ec0-7b29-488c-ae0f-ec0c2cc1ad49 service nova] Creating event network-changed:8f81a0ab-db08-458a-a907-344e54cc9456 for instance c06b5eb5-e324-4e7d-a084-27a8344c861b on hv-cinder-84989 Aug 05 15:40:46.038254 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-725810e1-0882-409e-b461-4dab815647c8 req-43038ec0-7b29-488c-ae0f-ec0c2cc1ad49 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042253 Aug 05 15:40:46.038869 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 454/907] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:46.190494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:40:46.233768 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:46.234471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:46.240583 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:46.249454 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:46.249454 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:46.249454 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:46.249454 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:46.249835 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:46.379752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:46.387626 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6b5ea411-00c4-406b-9a3a-ea505ee751ce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.157979 Aug 05 15:40:46.388148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 455/908] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:46 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:40:46.412021 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4bac9aee-2ac0-4d87-b93b-5b42e4a79c20 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 204 len: 0 microversion: 2.1 time: 0.425032 Aug 05 15:40:46.412631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 454/909] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:40:45 2022] DELETE /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 15:40:46.421730 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:46.425463 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:46.433386 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:46.433883 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:46.434321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:46.435028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:46.435891 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:46.436395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:46.582547 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:46.590671 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9415eed5-8547-498c-9852-8cf374980774 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1579 microversion: 2.1 time: 0.173120 Aug 05 15:40:46.591244 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 456/910] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:46 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:47.414647 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:47.415339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:47.421770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:47.422185 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:47.422614 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:47.423298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:47.423758 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:47.424195 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:47.550857 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:47.558714 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d6795d44-0965-4413-a3f6-83c4044fc78a tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.148456 Aug 05 15:40:47.559261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 455/911] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:47 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:47.612323 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:47.612939 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:47.615430 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:47.620784 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:47.621266 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:47.621701 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:47.622395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:47.622887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:47.623271 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:47.756849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:47.764210 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7b731764-1bf0-4df5-9dc6-d0a7c5607142 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1579 microversion: 2.1 time: 0.155748 Aug 05 15:40:47.764775 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 457/912] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:47 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:48.579984 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:48.580622 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:48.586773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:48.587255 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:48.587690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:48.588412 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:48.588873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:48.589328 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:48.607219 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:48.717030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:48.724361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-647036b4-92db-4478-8f81-150168e40c61 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.148162 Aug 05 15:40:48.725183 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 456/913] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:48 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:48.785973 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:48.786756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:48.793720 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:48.794200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:48.794653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:48.795326 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:48.795774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:48.796228 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:48.973849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:48.981905 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-86c8bf6b-cb57-4f4c-97f5-89b4a6c6c3c7 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1579 microversion: 2.1 time: 0.199898 Aug 05 15:40:48.982479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 458/914] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:48 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1579 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:49.746042 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:49.746578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:49.754247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:49.754724 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:49.755182 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:49.755869 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:49.756347 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:49.756772 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:49.943053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:49.950417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-57320a19-6f30-4069-856c-976d41bcf713 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.208889 Aug 05 15:40:49.950974 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 457/915] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:49 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:50.002625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:50.003308 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:50.009797 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:50.010279 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:50.010721 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:50.011474 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:50.011931 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:50.012385 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:50.222789 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:50.230862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1a24a3e7-62c3-4cc6-9d5e-6a9d72e170fd tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1579 microversion: 2.1 time: 0.232105 Aug 05 15:40:50.231433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 459/916] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:49 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1579 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:50.971559 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:50.972222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:50.979598 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:50.980101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:50.980634 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:50.981271 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:50.981718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:50.982134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:51.050983 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-e5d443c5-ae65-408b-b7fa-bd409ef69854 req-3920eb6b-4ee6-4f8c-b109-00086bab74b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06b5eb5-e324-4e7d-a084-27a8344c861b", "name": "network-vif-deleted", "tag": "8f81a0ab-db08-458a-a907-344e54cc9456"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:51.061127 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e5d443c5-ae65-408b-b7fa-bd409ef69854 req-3920eb6b-4ee6-4f8c-b109-00086bab74b4 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:51.061601 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e5d443c5-ae65-408b-b7fa-bd409ef69854 req-3920eb6b-4ee6-4f8c-b109-00086bab74b4 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:51.062027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e5d443c5-ae65-408b-b7fa-bd409ef69854 req-3920eb6b-4ee6-4f8c-b109-00086bab74b4 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:51.073633 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-e5d443c5-ae65-408b-b7fa-bd409ef69854 req-3920eb6b-4ee6-4f8c-b109-00086bab74b4 service nova] Creating event network-vif-deleted:8f81a0ab-db08-458a-a907-344e54cc9456 for instance c06b5eb5-e324-4e7d-a084-27a8344c861b on hv-cinder-84989 Aug 05 15:40:51.078416 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-e5d443c5-ae65-408b-b7fa-bd409ef69854 req-3920eb6b-4ee6-4f8c-b109-00086bab74b4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031174 Aug 05 15:40:51.079001 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 460/917] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:40:51.118949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:51.126353 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a5dea660-fbfe-4ba3-b160-aec0919b24af tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1366 microversion: 2.1 time: 0.159278 Aug 05 15:40:51.126910 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 458/918] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:50 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:51.253225 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:51.253922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:51.260699 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:51.261128 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:51.261564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:51.262272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:51.262720 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:51.263151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:51.327050 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:51.335084 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b8d88a61-763e-456e-afa0-35098f09b839 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1392 microversion: 2.1 time: 0.086097 Aug 05 15:40:51.335834 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 461/919] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:51 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1392 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:52.147048 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:52.147656 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:52.154996 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.155475 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.155910 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.156646 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.157093 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.157516 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.291686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:52.299354 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-12d1a18d-92f8-4da1-ab4c-5bf53bbb9efd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1557 microversion: 2.1 time: 0.156147 Aug 05 15:40:52.299955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 459/920] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:52 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:52.319980 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:52.321074 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:52.329378 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.329990 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.330533 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.331471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.333079 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.334568 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.353330 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:40:52.356431 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:52.360694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:52.362899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.363380 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.363811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.364523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.364971 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.365390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.396607 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.397142 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.397514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.397956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lazy-loading 'fault' on Instance uuid c06b5eb5-e324-4e7d-a084-27a8344c861b {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:40:52.430332 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-698f85f7-7776-4312-897b-fa4c486e93dd tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114243 Aug 05 15:40:52.431035 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 462/921] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 15:40:52 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:52.447861 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1782b4e84c9f484297e17c248738105c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b26247f85d45c0a7c1e763758f2e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:52.456344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f7a1cf1d-ec06-4948-afac-3a775f8da944 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 200 len: 1231 microversion: 2.1 time: 0.103759 Aug 05 15:40:52.457231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 460/922] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:52 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:40:52.843847 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:52.844411 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:52.850649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.851132 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.851614 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.852395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:52.852891 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:52.857602 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:52.935571 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lazy-loading 'services' on Instance uuid 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:40:53.126300 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ef671d6e-b299-41f2-a34a-337b179581b2 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde/os-volume_attachments/e01d6ec9-9749-46cb-afd8-2c1af6214b60" status: 202 len: 0 microversion: 2.1 time: 0.286297 Aug 05 15:40:53.127218 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 463/923] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:40:52 2022] DELETE /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde/os-volume_attachments/e01d6ec9-9749-46cb-afd8-2c1af6214b60 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:40:53.478723 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:53.479909 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: c06b5eb5-e324-4e7d-a084-27a8344c861b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:53.486355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:53.486844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:53.487281 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:53.490068 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:53.490068 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:53.490068 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:53.502563 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] HTTP exception thrown: Instance c06b5eb5-e324-4e7d-a084-27a8344c861b could not be found. Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Request method failure captured: Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b HTTP/1.1 Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TggOUGASJ2xEeUWjiMlZQ8nvKC4dC76mMYmGiEGTuyEluIIWhFQ2bBA_wOrHpPW89KmGTXHKIDjw0oUcRfXNmMKZV_WnvYjIhO8o8Cf-OTNLHz0FjXR4E7ZzuaVbIaHmHQ5INfr5ubNYIOWIHOjxMRUnihxnbqM4bbUzX0RllJWv74 Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:40:53.504261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99b26247f85d45c0a7c1e763758f2e69", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99b26247f85d45c0a7c1e763758f2e69"}]}] Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 1782b4e84c9f484297e17c248738105c Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance c06b5eb5-e324-4e7d-a084-27a8344c861b could not be found. Aug 05 15:40:53.505959 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'c06b5eb5-e324-4e7d-a084-27a8344c861b'} Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06b5eb5-e324-4e7d-a084-27a8344c861b could not be found. Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:53.506816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06b5eb5-e324-4e7d-a084-27a8344c861b could not be found. Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06b5eb5-e324-4e7d-a084-27a8344c861b could not be found. Aug 05 15:40:53.508377 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:53.509888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Returning 404 to user: Instance c06b5eb5-e324-4e7d-a084-27a8344c861b could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:53.509888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-09b62113-1abb-4cef-96ff-7d953a7ec78b tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b" status: 404 len: 111 microversion: 2.1 time: 0.031511 Aug 05 15:40:53.509888 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 461/924] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:53 2022] GET /compute/v2.1/servers/c06b5eb5-e324-4e7d-a084-27a8344c861b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:40:53.702380 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-67fe3cbc-a630-4019-b9ba-d844878548ac req-590e66f2-c9db-44aa-baf6-789bdefa49a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98fdfc63-b5ab-461d-a014-ea82d1d65b0b", "tag": "9a390035-5da3-4925-af6e-1b9b968c2cb4"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:53.713157 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-67fe3cbc-a630-4019-b9ba-d844878548ac req-590e66f2-c9db-44aa-baf6-789bdefa49a9 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:53.713659 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-67fe3cbc-a630-4019-b9ba-d844878548ac req-590e66f2-c9db-44aa-baf6-789bdefa49a9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:53.714164 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-67fe3cbc-a630-4019-b9ba-d844878548ac req-590e66f2-c9db-44aa-baf6-789bdefa49a9 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:53.725704 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-67fe3cbc-a630-4019-b9ba-d844878548ac req-590e66f2-c9db-44aa-baf6-789bdefa49a9 service nova] Creating event network-changed:9a390035-5da3-4925-af6e-1b9b968c2cb4 for instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b on hv-cinder-84989 Aug 05 15:40:53.731466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-67fe3cbc-a630-4019-b9ba-d844878548ac req-590e66f2-c9db-44aa-baf6-789bdefa49a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034050 Aug 05 15:40:53.734497 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 464/925] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:40:54.050717 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:54.051434 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:54.061960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:54.062631 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:54.063261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:54.063983 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:54.064699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:54.065118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:54.080419 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] HTTP exception thrown: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Request method failure captured: Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: DELETE /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 HTTP/1.1 Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TggOUGASJ2xEeUWjiMlZQ8nvKC4dC76mMYmGiEGTuyEluIIWhFQ2bBA_wOrHpPW89KmGTXHKIDjw0oUcRfXNmMKZV_WnvYjIhO8o8Cf-OTNLHz0FjXR4E7ZzuaVbIaHmHQ5INfr5ubNYIOWIHOjxMRUnihxnbqM4bbUzX0RllJWv74 Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:40:54.082468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99b26247f85d45c0a7c1e763758f2e69", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99b26247f85d45c0a7c1e763758f2e69"}]}] Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 1782b4e84c9f484297e17c248738105c Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.084174 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '17362876-caa1-4703-8c1f-11c09b21eea8'} Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:54.085079 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.086578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.087844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Returning 404 to user: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:54.087844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0ec3a78c-9b10-46dc-a696-2d36babab69e tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "DELETE /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 404 len: 111 microversion: 2.1 time: 0.040246 Aug 05 15:40:54.087844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 462/926] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:40:54 2022] DELETE /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:40:54.096909 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:54.097859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] [instance: 17362876-caa1-4703-8c1f-11c09b21eea8] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:54.104693 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:54.106067 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:54.106684 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:54.107595 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:54.108055 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:54.108508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:54.126092 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] HTTP exception thrown: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Request method failure captured: Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 HTTP/1.1 Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TggOUGASJ2xEeUWjiMlZQ8nvKC4dC76mMYmGiEGTuyEluIIWhFQ2bBA_wOrHpPW89KmGTXHKIDjw0oUcRfXNmMKZV_WnvYjIhO8o8Cf-OTNLHz0FjXR4E7ZzuaVbIaHmHQ5INfr5ubNYIOWIHOjxMRUnihxnbqM4bbUzX0RllJWv74 Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:40:54.128516 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99b26247f85d45c0a7c1e763758f2e69", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b26247f85d45c0a7c1e763758f2e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99b26247f85d45c0a7c1e763758f2e69"}]}] Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 99b26247f85d45c0a7c1e763758f2e69 Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-TestVolumeBootPattern-1824595652 Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 1782b4e84c9f484297e17c248738105c Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-TestVolumeBootPattern-1824595652-project Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.130156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '17362876-caa1-4703-8c1f-11c09b21eea8'} Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:54.131156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. Aug 05 15:40:54.132644 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:54.135411 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Returning 404 to user: Instance 17362876-caa1-4703-8c1f-11c09b21eea8 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:54.136333 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0b92a653-ba8b-4ff7-9139-64171a3a8981 tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8" status: 404 len: 111 microversion: 2.1 time: 0.044313 Aug 05 15:40:54.137937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 465/927] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:54 2022] GET /compute/v2.1/servers/17362876-caa1-4703-8c1f-11c09b21eea8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:40:54.262798 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:54.263560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:54.269577 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:54.270054 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:54.270483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:54.271233 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:54.271629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:54.272045 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:54.299217 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:40:54.607003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d83db775-5bdb-41f5-818d-b311e383d83f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 204 len: 0 microversion: 2.1 time: 0.347495 Aug 05 15:40:54.616763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 463/928] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:40:54 2022] DELETE /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:40:54.617225 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:54.617225 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:54.623257 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:54.623750 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:54.624221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:54.624929 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:54.625387 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:54.625816 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:54.772284 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:54.782076 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ea367ab7-ee4f-4099-a55e-592f9b5aada3 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1515 microversion: 2.1 time: 0.169933 Aug 05 15:40:54.782656 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 466/929] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:54 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:55.649830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2524ee7d-0ca9-460c-80a9-7064959a7d1c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] Calling method '.version_select at 0x7fcb14e01310>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:55.720204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2524ee7d-0ca9-460c-80a9-7064959a7d1c tempest-TestVolumeBootPattern-1824595652 tempest-TestVolumeBootPattern-1824595652-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1091585729" status: 202 len: 0 microversion: 2.1 time: 0.074533 Aug 05 15:40:55.720728 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 464/930] 10.222.0.40 () {58 vars in 1263 bytes} [Fri Aug 5 15:40:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1091585729 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:40:55.805453 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:55.806223 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:55.812595 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:55.813072 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:55.813509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:55.814201 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:55.814653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:55.815074 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:55.953380 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:55.961078 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a4f55f15-ac22-47ec-9ced-5c6473f6489e tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1515 microversion: 2.1 time: 0.159990 Aug 05 15:40:55.961645 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 467/931] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:55 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:56.982658 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:56.983384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:56.989340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:56.989825 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:56.990269 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:56.990967 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:56.991425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:56.991854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:57.124351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:57.131856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-884efee3-53c9-4ff0-9b94-1930fd286556 tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1515 microversion: 2.1 time: 0.153648 Aug 05 15:40:57.132520 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 465/932] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:56 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:57.371586 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-2d660d89-c0b7-4f8e-ab9e-ad3309de5372 req-d256f8d8-04ce-499b-9f63-b27d4d74a34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde", "name": "network-vif-deleted", "tag": "0963283c-b392-4f5e-b5f4-4ffe8b59f44d"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:40:57.384269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-2d660d89-c0b7-4f8e-ab9e-ad3309de5372 req-d256f8d8-04ce-499b-9f63-b27d4d74a34b service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:57.384743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-2d660d89-c0b7-4f8e-ab9e-ad3309de5372 req-d256f8d8-04ce-499b-9f63-b27d4d74a34b service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:57.385166 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-2d660d89-c0b7-4f8e-ab9e-ad3309de5372 req-d256f8d8-04ce-499b-9f63-b27d4d74a34b service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:57.408610 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-2d660d89-c0b7-4f8e-ab9e-ad3309de5372 req-d256f8d8-04ce-499b-9f63-b27d4d74a34b service nova] Creating event network-vif-deleted:0963283c-b392-4f5e-b5f4-4ffe8b59f44d for instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde on hv-cinder-84989 Aug 05 15:40:57.415080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-2d660d89-c0b7-4f8e-ab9e-ad3309de5372 req-d256f8d8-04ce-499b-9f63-b27d4d74a34b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046896 Aug 05 15:40:57.415920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 468/933] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:40:58.153748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:58.154286 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:58.166275 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:58.167317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:58.168116 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:58.183187 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:58.185605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:58.186082 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:58.232907 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:58.233391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:58.234265 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:58.234720 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lazy-loading 'fault' on Instance uuid 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:40:58.278017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfb345e7c044b669ec6c4a6a79a28ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c62721dfdd46e3978fccce91b63791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:40:58.286120 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-2a06fcac-a0f3-4e86-a5cb-75d88b4ba78a tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 200 len: 1309 microversion: 2.1 time: 0.136250 Aug 05 15:40:58.286687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 466/934] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:58 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 1309 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:40:59.308563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:40:59.309263 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] [instance: 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:40:59.318017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:59.318506 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:59.318939 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:59.328589 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:40:59.329192 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:40:59.329777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:40:59.345051 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] HTTP exception thrown: Instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde could not be found. Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Request method failure captured: Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde HTTP/1.1 Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TmQyLn0EZNvoXvp3n8FF12SV8X2v9Gm-OdijtgqiajjoW8r4hXFo4BFJ69t4BgmVlKUEDiAcQexgbyKat95TYMDzp_iqNQ1f-hYp3evgGVfMjRPUm_hwM-FITsPPFSK2n-rvGjej6jlFhe956ugJbhO3Lr7I0aRGvd9I_XomVtlfr8 Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 39c62721dfdd46e3978fccce91b63791 Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1263849729 Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:40:59.346728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_39c62721dfdd46e3978fccce91b63791", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39c62721dfdd46e3978fccce91b63791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39c62721dfdd46e3978fccce91b63791"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/39c62721dfdd46e3978fccce91b63791"}]}] Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-VolumesSnapshotTestJSON-1263849729 Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 39c62721dfdd46e3978fccce91b63791 Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1263849729 Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-VolumesSnapshotTestJSON-1263849729-project Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 8cfb345e7c044b669ec6c4a6a79a28ee Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-VolumesSnapshotTestJSON-1263849729-project Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde could not be found. Aug 05 15:40:59.348545 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde'} Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde could not be found. Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:40:59.349438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde could not be found. Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde could not be found. Aug 05 15:40:59.350916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:40:59.352292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] Returning 404 to user: Instance 4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:40:59.352292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fae18134-3537-44b1-b488-1de1ddcd384f tempest-VolumesSnapshotTestJSON-1263849729 tempest-VolumesSnapshotTestJSON-1263849729-project] 10.222.0.40 "GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde" status: 404 len: 111 microversion: 2.1 time: 0.044595 Aug 05 15:40:59.352292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 469/935] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:40:59 2022] GET /compute/v2.1/servers/4ebb1e01-ba6e-404a-83c9-c93f9cc1fbde => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:41:29.776268 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:29.777421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:29.779956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:41:29.781090 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:41:29.787497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:29.788003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:29.788507 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:29.789235 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:29.789693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:29.790121 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:29.834389 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-42d06054-27a3-42f0-91f0-b99624c267a6 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/ips" status: 200 len: 151 microversion: 2.1 time: 0.062387 Aug 05 15:41:29.845800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 467/936] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:41:29 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/ips => generated 151 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:41:31.490066 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5695fde6-2aa8-447d-b569-a103d1816db5"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:31.492409 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:31.495903 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=25 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:41:31.496566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:41:31.500123 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:31.500793 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:31.502202 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:31.502202 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:31.503005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:31.503435 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:32.343250 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-95e7e790-e9ab-4cf8-bbca-d355cd23ffce tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856839 Aug 05 15:41:32.349918 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 470/937] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:41:31 2022] POST /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:41:39.968644 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5695fde6-2aa8-447d-b569-a103d1816db5"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:39.971547 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:39.983070 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:39.985822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:39.985822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:39.985822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:39.985822 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:39.986556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:40.096671 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Invalid volume: volume 5695fde6-2aa8-447d-b569-a103d1816db5 is already attached to instances: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: POST /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments HTTP/1.1 Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 74 Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:41:40.098396 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {"volumeAttachment": {"volumeId": "5695fde6-2aa8-447d-b569-a103d1816db5"}} Aug 05 15:41:40.100224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Invalid volume: volume 5695fde6-2aa8-447d-b569-a103d1816db5 is already attached to instances: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'server_id': '98fdfc63-b5ab-461d-a014-ea82d1d65b0b', 'body': {'volumeAttachment': {'volumeId': '5695fde6-2aa8-447d-b569-a103d1816db5'}}} Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5695fde6-2aa8-447d-b569-a103d1816db5 is already attached to instances: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:40.101528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5695fde6-2aa8-447d-b569-a103d1816db5 is already attached to instances: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:41:40.103292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:41:40.105213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:41:40.105213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:41:40.105213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:41:40.105213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5695fde6-2aa8-447d-b569-a103d1816db5 is already attached to instances: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b Aug 05 15:41:40.105213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:40.105213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 400 to user: Invalid volume: volume 5695fde6-2aa8-447d-b569-a103d1816db5 is already attached to instances: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:41:40.105213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b1b5b48e-bca6-4911-8b94-ba89cc5b6a39 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138273 Aug 05 15:41:40.105213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 468/938] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:41:39 2022] POST /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments => generated 174 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 15:41:40.175921 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:40.177126 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:40.184796 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:40.185272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:40.185822 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:40.186604 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:40.187057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:40.187477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:40.281311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lazy-loading 'services' on Instance uuid 98fdfc63-b5ab-461d-a014-ea82d1d65b0b {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:41:40.496447 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-27f4fa68-c32b-4d79-9892-a343413babe8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments/5695fde6-2aa8-447d-b569-a103d1816db5" status: 202 len: 0 microversion: 2.1 time: 0.331831 Aug 05 15:41:40.497581 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 471/939] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:41:40 2022] DELETE /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments/5695fde6-2aa8-447d-b569-a103d1816db5 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:41:40.506625 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:40.509193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:40.517464 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:40.518299 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:40.518930 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:40.519652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:40.520133 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:40.520567 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:40.558841 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c5bf3f5e-f9ca-4d41-94cb-02c55847f071 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056581 Aug 05 15:41:40.559585 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 469/940] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:41:40 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:41:41.573150 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:41.576446 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:41.582952 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:41.583502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:41.584245 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:41.585009 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:41.585522 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:41.586147 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:41.641924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-eef2d0bc-4119-46d3-ab73-a442d4fa5a65 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074450 Aug 05 15:41:41.647821 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 472/941] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:41:41 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 15:41:41.749364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:41.749852 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:41.756738 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:41.757494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:41.758101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:41.763291 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:41.763962 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:41.764576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:41.792944 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:41:42.177653 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5f331e55-c380-43a4-8e16-4e54598d33e7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 204 len: 0 microversion: 2.1 time: 0.431877 Aug 05 15:41:42.178261 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 470/942] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:41:41 2022] DELETE /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:41:42.186983 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:42.187847 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:42.194265 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:42.194896 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:42.195445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:42.196906 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:42.197472 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:42.198000 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:42.349313 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:42.357688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5ecde07d-eeea-4fc3-aab7-d1704a368486 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1682 microversion: 2.1 time: 0.174563 Aug 05 15:41:42.365973 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 473/943] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:42 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:43.379460 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:43.380384 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:43.388042 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:43.388558 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:43.389415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:43.390315 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:43.391000 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:43.391624 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:43.555305 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:43.564225 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8a36a7e4-2bf0-4fa4-a94c-e3ed1c3b3066 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1682 microversion: 2.1 time: 0.188827 Aug 05 15:41:43.564856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 471/944] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:43 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:44.586705 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:44.587876 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:44.598284 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:44.604493 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:44.605169 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:44.606114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:44.606729 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:44.607341 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:44.715766 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:44.728858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-dcaf1a90-b3b7-4a5c-9e28-37255db02b91 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1615 microversion: 2.1 time: 0.145873 Aug 05 15:41:44.733412 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 474/945] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:44 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1615 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:45.014546 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-3a271db3-eba1-4e51-a2fd-f70b65f2613a req-aebdff0a-745d-4779-a807-580a11b95732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fdfc63-b5ab-461d-a014-ea82d1d65b0b", "name": "network-vif-deleted", "tag": "9a390035-5da3-4925-af6e-1b9b968c2cb4"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:45.024237 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-3a271db3-eba1-4e51-a2fd-f70b65f2613a req-aebdff0a-745d-4779-a807-580a11b95732 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:45.024743 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-3a271db3-eba1-4e51-a2fd-f70b65f2613a req-aebdff0a-745d-4779-a807-580a11b95732 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:45.025170 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-3a271db3-eba1-4e51-a2fd-f70b65f2613a req-aebdff0a-745d-4779-a807-580a11b95732 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:45.044471 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-3a271db3-eba1-4e51-a2fd-f70b65f2613a req-aebdff0a-745d-4779-a807-580a11b95732 service nova] Creating event network-vif-deleted:9a390035-5da3-4925-af6e-1b9b968c2cb4 for instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b on hv-cinder-84989 Aug 05 15:41:45.050032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-3a271db3-eba1-4e51-a2fd-f70b65f2613a req-aebdff0a-745d-4779-a807-580a11b95732 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.320060 Aug 05 15:41:45.054688 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 472/946] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:41:45.750298 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:45.751068 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:45.762846 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:45.763335 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:45.763976 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:45.764908 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:45.765354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:45.765774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:45.807696 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:45.808472 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:45.809281 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:45.809972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lazy-loading 'fault' on Instance uuid 98fdfc63-b5ab-461d-a014-ea82d1d65b0b {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:41:45.867705 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:45.875652 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5cc605ae-9e35-4244-b58d-6593bd4ea3ef tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 200 len: 1331 microversion: 2.1 time: 0.129109 Aug 05 15:41:45.878381 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 475/947] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:45 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:46.902300 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:46.902997 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:46.910686 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:46.911464 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:46.912171 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:46.913375 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:46.914073 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:46.915574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:46.933055 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b HTTP/1.1 Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:41:46.935600 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:41:46.937033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '98fdfc63-b5ab-461d-a014-ea82d1d65b0b'} Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:41:46.937856 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:41:46.939340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:41:46.941927 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:41:46.944003 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a6d42667-085d-48ad-b448-9697547e8d99 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 404 len: 111 microversion: 2.1 time: 0.046347 Aug 05 15:41:46.945199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 473/948] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:46 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:41:46.955461 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9b95b596-7904-401c-922a-79507b7a5485 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '.version_select at 0x7fcb14f2a1f0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:47.373167 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9b95b596-7904-401c-922a-79507b7a5485 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687114848" status: 202 len: 0 microversion: 2.1 time: 0.423051 Aug 05 15:41:47.373777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 476/949] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 15:41:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687114848 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:41:48.299034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-746e462f-cd04-44eb-93fa-1a585c731a0e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: .version_select at 0x7fcb1972b4c0>, body: {"keypair": {"name": "tempest-keypair-1356995811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADfVXWbV/6CIo181FP025a2aBvMekJf/NR4S5zANvopr5SMmAUR0HLmfYeTX4/M6CPrIbt4vz/J+LWgvz1/0RQ7muOMGoNTk0DW1d3pitel1tYltqft0d3aDwZBMuwamg=="}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:48.317300 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-746e462f-cd04-44eb-93fa-1a585c731a0e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for project 2c77da48edba4903a1c51fee2a856167. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:41:48.321880 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-746e462f-cd04-44eb-93fa-1a585c731a0e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for user dd5c43d63a754eeaaba429f5c8153bba and project 2c77da48edba4903a1c51fee2a856167. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:41:48.402045 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-746e462f-cd04-44eb-93fa-1a585c731a0e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107004 Aug 05 15:41:48.402743 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 474/950] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:41:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:41:50.968488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2098970858", "imageRef": "bbce6e43-30d7-4b5b-a805-da7c0b29a3cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b05605aa-dd0e-428b-8865-2528537f12f7"}], "security_groups": [{"name": "tempest-securitygroup--1523318558"}], "key_name": "tempest-keypair-1356995811", "user_data": "}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:51.074143 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.network.neutron [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] validate_networks() for [('b05605aa-dd0e-428b-8865-2528537f12f7', None, None, None, None, None)] {{(pid=118723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:41:51.227188 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-829eff78-21e3-4f39-98fb-b08ecb6d9bea tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Action: 'create', calling method: .version_select at 0x7fcb14ef6160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2052878287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4LMzh7MbNopkAAGWJ6ABAA2dtkCExFKRcbkC2dHfq2CIU0dJH2msCfwFLJs1mPNgP98FyrZ5ItdQzfpnThaNp24lHQBif6J+RvqmjgdUWcBbt83uLUiljZ91M/GviZmg=="}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:51.243514 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-829eff78-21e3-4f39-98fb-b08ecb6d9bea tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Getting quotas for project 6e62e9372a7a47528e7973537bebbfb6. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:41:51.247323 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-829eff78-21e3-4f39-98fb-b08ecb6d9bea tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Getting quotas for user 8ffd179bd4a445eaafb53d7accede863 and project 6e62e9372a7a47528e7973537bebbfb6. Resources: {'key_pairs'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:41:51.333189 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-829eff78-21e3-4f39-98fb-b08ecb6d9bea tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.110386 Aug 05 15:41:51.333956 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 475/951] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 15:41:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:41:51.388863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1699736272", "imageRef": "f89bf1bb-e962-4682-8594-383911c23f93", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2052878287", "networks": [{"uuid": "ea94c7fb-f199-4a01-9cab-f73506204f6e"}]}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:51.440383 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.network.neutron [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] validate_networks() for [('ea94c7fb-f199-4a01-9cab-f73506204f6e', None, None, None, None, None)] {{(pid=118722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 15:41:51.631638 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Flavor limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:41:51.632057 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Image limits 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:41:51.632560 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Flavor pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:41:51.632992 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Image pref 0:0:0 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:41:51.633399 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.virt.hardware [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:41:51.645139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:51.645781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:51.646226 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:51.646966 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:51.647432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:51.647867 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:51.669792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for project 2c77da48edba4903a1c51fee2a856167. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:41:51.673771 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.quota [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Getting quotas for user dd5c43d63a754eeaaba429f5c8153bba and project 2c77da48edba4903a1c51fee2a856167. Resources: {'instances', 'cores', 'ram'} {{(pid=118723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:41:51.685489 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Going to run 1 instances... {{(pid=118723) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:41:51.687772 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbce6e43-30d7-4b5b-a805-da7c0b29a3cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:41:51.797520 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e13eee38-3f2d-4cad-9d90-0c3fae943124 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.833932 Aug 05 15:41:51.798379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 477/952] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:41:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 15:41:51.808991 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b1462a4b-7ef9-4e8f-a373-f88f78bc3f9b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:51.809419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b1462a4b-7ef9-4e8f-a373-f88f78bc3f9b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:51.885889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b1462a4b-7ef9-4e8f-a373-f88f78bc3f9b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:51.893488 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b1462a4b-7ef9-4e8f-a373-f88f78bc3f9b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1242 microversion: 2.1 time: 0.088418 Aug 05 15:41:51.894046 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 478/953] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:51 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:51.983530 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Flavor limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 15:41:51.984025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Image limits 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 15:41:51.984604 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Flavor pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 15:41:51.985146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Image pref 0:0:0 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 15:41:51.985622 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.virt.hardware [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 15:41:51.994358 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:51.994907 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:51.995410 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:51.996298 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:51.996816 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:51.997317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:52.016668 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Getting quotas for project 6e62e9372a7a47528e7973537bebbfb6. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 15:41:52.020773 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.quota [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Getting quotas for user 8ffd179bd4a445eaafb53d7accede863 and project 6e62e9372a7a47528e7973537bebbfb6. Resources: {'instances', 'cores', 'ram'} {{(pid=118722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 15:41:52.032652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Going to run 1 instances... {{(pid=118722) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 15:41:52.034844 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f89bf1bb-e962-4682-8594-383911c23f93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 15:41:52.162616 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-26a5befe-b08e-4530-8359-8905fa1e369f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777577 Aug 05 15:41:52.163173 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 476/954] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 15:41:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 15:41:52.173739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-68759587-ca5f-4315-9a0c-301d027ebeab tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:52.174356 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-68759587-ca5f-4315-9a0c-301d027ebeab tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:52.232027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-68759587-ca5f-4315-9a0c-301d027ebeab tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:52.239261 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-68759587-ca5f-4315-9a0c-301d027ebeab tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1259 microversion: 2.1 time: 0.069351 Aug 05 15:41:52.239888 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 479/955] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:52 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:52.915870 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:52.916497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:52.922643 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:52.923129 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:52.923632 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:52.924356 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:52.924808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:52.925227 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:52.996990 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:53.005028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-59087f4d-1435-446c-85cd-8f6754711060 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1246 microversion: 2.1 time: 0.094089 Aug 05 15:41:53.005667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 477/956] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:52 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:53.260945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8319cd61-786e-461f-90f1-3654fb0f0209 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:53.261552 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8319cd61-786e-461f-90f1-3654fb0f0209 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:53.330873 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8319cd61-786e-461f-90f1-3654fb0f0209 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:53.339129 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8319cd61-786e-461f-90f1-3654fb0f0209 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1259 microversion: 2.1 time: 0.082011 Aug 05 15:41:53.339743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 480/957] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:53 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:54.026740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:54.026740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:54.033971 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:54.034452 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:54.034894 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:54.035576 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:54.036147 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:54.036503 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:54.109277 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:54.117324 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f53234da-5412-4439-8def-6604d7970fcf tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1312 microversion: 2.1 time: 0.095231 Aug 05 15:41:54.118465 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 478/958] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:54 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:54.360678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:54.361994 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:54.369261 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:54.369748 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:54.370189 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:54.370897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:54.371372 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:54.371788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:54.436293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:54.444080 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-912cf845-0119-4610-a8f9-c1443b2a7474 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1311 microversion: 2.1 time: 0.087291 Aug 05 15:41:54.444656 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 481/959] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:54 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:55.143357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:55.144697 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:55.153818 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:55.154355 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:55.155643 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:55.156864 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:55.157523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:55.158390 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:55.334806 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:55.342618 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-48e29765-1c22-47db-a0d2-038660a64a60 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.207233 Aug 05 15:41:55.343518 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 479/960] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:55 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:55.472573 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:55.474054 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:55.490281 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:55.494979 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:55.495792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:55.496999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:55.498641 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:55.499342 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:55.755445 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:55.773752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-658e8c1a-a8e8-4c95-a8ed-4523b7b8389e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.303434 Aug 05 15:41:55.783764 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 482/961] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:55 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:55.818364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-593be8a3-f894-4f62-a147-0300b24f4ddf req-4ad4910b-45c8-40e6-b646-1c8bb8c527e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409a8b9a-dd6d-47de-9bae-db7fa17239e3", "tag": "ed67b356-a381-4fff-b159-68d2d2cfd2a2"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:55.836253 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-593be8a3-f894-4f62-a147-0300b24f4ddf req-4ad4910b-45c8-40e6-b646-1c8bb8c527e7 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:55.842124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-593be8a3-f894-4f62-a147-0300b24f4ddf req-4ad4910b-45c8-40e6-b646-1c8bb8c527e7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:55.842124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-593be8a3-f894-4f62-a147-0300b24f4ddf req-4ad4910b-45c8-40e6-b646-1c8bb8c527e7 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:55.851665 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-593be8a3-f894-4f62-a147-0300b24f4ddf req-4ad4910b-45c8-40e6-b646-1c8bb8c527e7 service nova] Creating event network-changed:ed67b356-a381-4fff-b159-68d2d2cfd2a2 for instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 on hv-cinder-84989 Aug 05 15:41:55.860659 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-593be8a3-f894-4f62-a147-0300b24f4ddf req-4ad4910b-45c8-40e6-b646-1c8bb8c527e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045201 Aug 05 15:41:55.862407 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 480/962] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 15:41:56.364864 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:56.365543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:56.382059 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:56.382728 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:56.383259 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:56.384279 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:56.384982 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:56.385627 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:56.648339 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:56.664828 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-00a03fc9-218c-4d6d-922a-00f481f37044 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.303749 Aug 05 15:41:56.665566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 483/963] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:56 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:56.805479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:56.806108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:56.822833 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:56.823898 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:56.824473 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:56.825256 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:56.825719 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:56.826151 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:56.839344 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-2d677ae1-83ef-4bf5-851f-268b81d3ad04 req-eef024a5-a191-47c8-93e5-d9d6217b1fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f4ac26-5bea-44a0-9a56-8f33e3006c10", "tag": "48995f61-b1de-411b-9621-65e545d953f7"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:41:56.850723 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-2d677ae1-83ef-4bf5-851f-268b81d3ad04 req-eef024a5-a191-47c8-93e5-d9d6217b1fd5 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:56.858134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-2d677ae1-83ef-4bf5-851f-268b81d3ad04 req-eef024a5-a191-47c8-93e5-d9d6217b1fd5 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:56.858134 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-2d677ae1-83ef-4bf5-851f-268b81d3ad04 req-eef024a5-a191-47c8-93e5-d9d6217b1fd5 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:56.864014 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-2d677ae1-83ef-4bf5-851f-268b81d3ad04 req-eef024a5-a191-47c8-93e5-d9d6217b1fd5 service nova] Creating event network-changed:48995f61-b1de-411b-9621-65e545d953f7 for instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 on hv-cinder-84989 Aug 05 15:41:56.869511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-2d677ae1-83ef-4bf5-851f-268b81d3ad04 req-eef024a5-a191-47c8-93e5-d9d6217b1fd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106169 Aug 05 15:41:56.879667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 481/964] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:41:56.991653 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:57.001364 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e7bbe4ca-a782-45cc-9761-02477b88eb3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.200221 Aug 05 15:41:57.003037 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 484/965] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:56 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:41:57.686992 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:57.688234 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:57.694949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:57.695673 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:57.696351 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:57.697232 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:57.697854 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:57.698575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:57.843922 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:57.851681 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5900f547-9828-4934-bac0-efab7bdd0308 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.168952 Aug 05 15:41:57.852929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 482/966] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:57 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:58.022846 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:58.024676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:58.031732 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:58.032502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:58.033105 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:58.034165 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:58.034788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:58.035641 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:58.171913 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:58.181200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1d83eae5-b07e-46ed-9452-d0e8676a5d3c tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.162255 Aug 05 15:41:58.182113 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 485/967] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:58 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:58.874424 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:58.925742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:58.925742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:58.925742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:58.925742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:58.926223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:58.926223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:58.926223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:59.071603 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:59.080731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-893cb44b-96b8-41b8-8154-3b4030fd6934 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.210641 Aug 05 15:41:59.092486 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 483/968] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:58 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:41:59.202441 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:41:59.203106 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:41:59.211790 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:59.212860 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:59.213307 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:59.214032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:41:59.214490 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:41:59.214981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:41:59.355193 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:41:59.363520 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9c138508-e39d-46fc-b398-aec10d50a15a tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.165029 Aug 05 15:41:59.364156 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 486/969] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:41:59 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:00.103724 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:00.104360 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:00.110713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:00.111193 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:00.111629 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:00.112347 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:00.112803 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:00.113232 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:00.275318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:00.284132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-284b562c-32a6-46db-809a-a9f52070e103 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.184240 Aug 05 15:42:00.284717 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 484/970] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:00 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:00.335419 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:00.336017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:00.343018 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:00.343559 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:00.344418 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:00.345408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:00.346012 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:00.346443 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:00.372224 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lazy-loading 'flavor' on Instance uuid c47d4294-a4d6-4950-b778-7e1947c6a8ef {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:42:00.388513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:00.389129 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:00.395131 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:00.395621 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:00.396058 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:00.396800 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:00.397252 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:00.397679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:00.511478 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:00.556192 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:00.564053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-f719e58c-1d03-4eca-b062-a6600dde6718 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.180528 Aug 05 15:42:00.564654 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 485/971] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:00 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:00.697841 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-ef0c9acb-2337-41bb-864e-7a53aa5baf38 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "POST /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef/action" status: 202 len: 0 microversion: 2.1 time: 0.365460 Aug 05 15:42:00.698720 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 487/972] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:42:00 2022] POST /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:42:00.706962 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:00.707562 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:00.713556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:00.714038 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:00.714468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:00.715222 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:00.715672 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:00.716103 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:00.869400 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:00.876383 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5fd809ee-931b-47b8-8ea3-40247177315d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.173221 Aug 05 15:42:00.876949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 486/973] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:00 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:01.306589 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:01.307287 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:01.313791 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:01.314344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:01.314739 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:01.315430 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:01.315923 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:01.316332 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:01.451707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:01.459353 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-849e52c4-9f1d-46cb-8367-dcf8f633a072 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.156991 Aug 05 15:42:01.459930 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 488/974] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:01 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:01.585732 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:01.586364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:01.592757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:01.593239 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:01.593673 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:01.594362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:01.594811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:01.595233 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:01.613935 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:01.728770 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:01.736872 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-15e66e57-b368-428d-8fd7-e39a120a96f6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.154921 Aug 05 15:42:01.737642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 487/975] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:01 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:01.897792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:01.898408 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:01.900410 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:01.901137 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:01.905860 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:01.911792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:01.911792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:01.911792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:01.911792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:01.912276 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:02.075982 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:02.083978 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a8ac4ecd-a80b-4d19-aa96-b46c9dee4c2b tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.190228 Aug 05 15:42:02.084779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 489/976] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:01 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:02.482480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:02.483099 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:02.485251 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=2 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:02.485935 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell0:SELECT=14 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:02.491004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:02.491495 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:02.491949 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:02.492687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:02.493131 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:02.493558 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:02.652617 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:02.660357 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1543d59e-1a5e-4746-a419-f770150696f1 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.183110 Aug 05 15:42:02.660914 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 488/977] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:02 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:02.758678 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:02.759882 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:02.766686 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:02.767279 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:02.767598 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:02.768340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:02.768801 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:02.769552 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:02.913808 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:02.921238 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a38dc2c5-fdc3-4b21-abb0-d2cf24cd5faf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.166513 Aug 05 15:42:02.921803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 490/978] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:02 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:03.105136 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:03.105740 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:03.112487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:03.113109 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:03.113826 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:03.114979 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:03.115727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:03.116387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:03.253981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:03.262204 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-6877732d-eca7-46a5-885f-b6149cd84f75 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.161175 Aug 05 15:42:03.262951 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 489/979] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:03 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:03.681750 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:03.682353 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:03.693548 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=12 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:03.698457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:03.698957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:03.699406 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:03.700248 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:03.700717 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:03.701148 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:03.927403 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:03.933165 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-33fa115e-b19f-404f-bdb6-8e142f886625 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.255974 Aug 05 15:42:03.933837 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 491/980] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:03 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:03.951890 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:03.956231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:03.959154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:03.959851 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:03.960745 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:03.961646 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:03.962641 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:03.963247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:04.167750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:04.176465 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-53dff170-159f-4fa1-8648-d4fdb5bfd24e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.228541 Aug 05 15:42:04.188338 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 490/981] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:03 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:04.285917 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:04.286604 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:04.292629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:04.293202 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:04.293707 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:04.294479 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:04.295009 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:04.295509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:04.513181 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:04.521143 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6e48ab70-7081-4266-9c7f-5523ab13a197 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.239474 Aug 05 15:42:04.521906 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 492/982] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:04 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:04.953398 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:04.954026 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:04.960453 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:04.960928 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:04.961358 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:04.962037 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:04.962484 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:04.962899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:05.091531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:05.098811 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4f8be2bb-fd65-4059-af81-9d1e0729a15b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.149316 Aug 05 15:42:05.099362 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 491/983] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:04 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:05.198027 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:05.198639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:05.205032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:05.205452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:05.205886 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:05.206576 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:05.207028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:05.207452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:05.332292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:05.340602 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6618c996-f3a7-4b95-a201-4a3ed7d6ae16 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.146373 Aug 05 15:42:05.341178 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 493/984] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:05 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:05.543305 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:05.543908 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:05.549790 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:05.550266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:05.550734 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:05.551415 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:05.551863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:05.552307 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:05.691842 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:05.700163 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e6a12f2e-81dc-4b9c-8658-cae12915e40f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.161276 Aug 05 15:42:05.700729 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 492/985] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:05 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:06.120664 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:06.121277 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:06.127153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:06.127631 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:06.128101 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:06.128792 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:06.129246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:06.129671 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:06.363943 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:06.364584 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:06.371276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:06.371675 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:06.372122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:06.372825 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:06.373272 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:06.373689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:06.590714 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:06.594903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:06.598238 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-4712d7e4-08fc-4408-9a95-c339f0ffcaa8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.482172 Aug 05 15:42:06.598814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 494/986] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:06 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:06.602601 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c62718c5-40ff-4ce0-a8a8-6d239a006f8b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.242513 Aug 05 15:42:06.603115 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 493/987] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:06 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:06.721260 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:06.721821 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:06.727709 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:06.728235 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:06.728711 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:06.729405 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:06.729863 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:06.730293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:06.861103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:06.869354 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-619ae1f7-7161-4d5b-b4cc-b7d038186146 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.151959 Aug 05 15:42:06.869912 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 495/988] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:06 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:07.618247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:07.618878 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:07.622848 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:07.623508 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:07.625366 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:07.625848 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:07.626443 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:07.627097 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:07.627408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:07.627825 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:07.629756 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:07.630241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:07.630680 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:07.631372 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:07.631823 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:07.632292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:07.824342 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:07.828313 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:07.832130 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5204e240-60d8-43d9-b761-6b246fa255c8 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.217927 Aug 05 15:42:07.832974 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 494/989] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:07 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:07.836221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-56d24ceb-cbda-4f23-9aff-5fb859234c09 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.216986 Aug 05 15:42:07.836789 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 496/990] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:07 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:07.890950 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:07.891564 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:07.894560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:07.898125 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:07.898611 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:07.899051 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:07.900419 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:07.900874 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:07.901305 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:08.036100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:08.058504 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ffcb9475-35e7-41f5-b60e-cf7d949cff34 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.171340 Aug 05 15:42:08.059748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 495/991] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:07 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:08.855271 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:08.855848 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:08.857838 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:08.858548 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:08.862311 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:08.862790 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:08.863219 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:08.863915 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:08.864421 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:08.864843 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:08.865194 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:08.865682 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:08.866125 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:08.866886 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:08.867556 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:08.867995 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:09.070039 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:09.074766 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:09.078302 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-7a5d8a73-084c-480c-b7a7-7c8a68ee9787 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.228436 Aug 05 15:42:09.078869 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 497/992] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:08 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:09.082719 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-62001d13-139b-4c68-9430-6719370b20b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.228921 Aug 05 15:42:09.083418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 496/993] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:08 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:09.083547 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:09.084023 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:09.089722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:09.090203 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:09.090642 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:09.091327 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:09.091892 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:09.092344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:09.224054 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:09.232966 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0fd6d5df-74f1-47cd-b510-d9210173df28 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.152806 Aug 05 15:42:09.233751 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 498/994] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:09 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:10.098677 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:10.099400 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:10.106395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:10.106882 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:10.107318 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:10.108015 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:10.108511 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:10.108965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:10.137064 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-585ebb32-eaa1-44d4-9a38-4ed73056914d req-cc4616fd-5f4a-4089-a7bb-e7e03f96d48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409a8b9a-dd6d-47de-9bae-db7fa17239e3", "name": "network-vif-plugged", "status": "completed", "tag": "ed67b356-a381-4fff-b159-68d2d2cfd2a2"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:10.159687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-585ebb32-eaa1-44d4-9a38-4ed73056914d req-cc4616fd-5f4a-4089-a7bb-e7e03f96d48d service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:10.160216 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-585ebb32-eaa1-44d4-9a38-4ed73056914d req-cc4616fd-5f4a-4089-a7bb-e7e03f96d48d service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:10.160768 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-585ebb32-eaa1-44d4-9a38-4ed73056914d req-cc4616fd-5f4a-4089-a7bb-e7e03f96d48d service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:10.184287 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-585ebb32-eaa1-44d4-9a38-4ed73056914d req-cc4616fd-5f4a-4089-a7bb-e7e03f96d48d service nova] Creating event network-vif-plugged:ed67b356-a381-4fff-b159-68d2d2cfd2a2 for instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 on hv-cinder-84989 Aug 05 15:42:10.190062 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-585ebb32-eaa1-44d4-9a38-4ed73056914d req-cc4616fd-5f4a-4089-a7bb-e7e03f96d48d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115042 Aug 05 15:42:10.191050 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 497/995] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:10.196863 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:10.197565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:10.215177 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:10.215757 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:10.216782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:10.217521 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:10.217981 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:10.218605 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:10.255184 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:10.263534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-a8b0f9cb-ef16-42b4-b762-d4865bbab863 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.168753 Aug 05 15:42:10.264118 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 499/996] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:10 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:10.268857 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:10.269763 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:10.276263 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:10.276824 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:10.278005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:10.278920 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:10.279381 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:10.279809 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:10.427807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:10.436428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-942fb8af-407f-4db1-9b20-125fb55e50a3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.244355 Aug 05 15:42:10.441369 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 498/997] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:10 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:10.464519 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:10.470015 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0ca89983-ed69-4cfd-b5b8-0e2cfa800ba9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.204731 Aug 05 15:42:10.470610 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 500/998] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:10 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:11.285726 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:11.286335 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:11.293425 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:11.293903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:11.294339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:11.295025 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:11.295479 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:11.295899 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:11.428446 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:11.435961 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-792e7411-4632-4dfb-82ea-fee59fb4ed6f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1368 microversion: 2.1 time: 0.154392 Aug 05 15:42:11.436557 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 499/999] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:11 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:11.457793 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:11.458507 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:11.465424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:11.465901 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:11.466368 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:11.467055 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:11.467502 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:11.467922 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:11.491104 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:11.491934 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:11.498090 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:11.498608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:11.499069 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:11.499772 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:11.500256 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:11.500681 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:11.646353 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:11.654301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-b49ac994-21b3-4574-88d5-dc822c5ea2b8 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.200392 Aug 05 15:42:11.655085 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 501/1000] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:11 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:11.674929 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:11.682463 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-32275328-1f6c-45dd-8eaa-f9a7b6eda952 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.195264 Aug 05 15:42:11.682960 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 500/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:11 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:12.206813 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-05e223ae-8c77-4e18-8aae-a6c619e2dca3 req-6cd8dee1-c552-471f-9288-4ccf94bc775e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f4ac26-5bea-44a0-9a56-8f33e3006c10", "name": "network-vif-plugged", "status": "completed", "tag": "48995f61-b1de-411b-9621-65e545d953f7"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:12.217519 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-05e223ae-8c77-4e18-8aae-a6c619e2dca3 req-6cd8dee1-c552-471f-9288-4ccf94bc775e service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.218033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-05e223ae-8c77-4e18-8aae-a6c619e2dca3 req-6cd8dee1-c552-471f-9288-4ccf94bc775e service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.218423 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-05e223ae-8c77-4e18-8aae-a6c619e2dca3 req-6cd8dee1-c552-471f-9288-4ccf94bc775e service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.229716 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-05e223ae-8c77-4e18-8aae-a6c619e2dca3 req-6cd8dee1-c552-471f-9288-4ccf94bc775e service nova] Creating event network-vif-plugged:48995f61-b1de-411b-9621-65e545d953f7 for instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 on hv-cinder-84989 Aug 05 15:42:12.234829 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-05e223ae-8c77-4e18-8aae-a6c619e2dca3 req-6cd8dee1-c552-471f-9288-4ccf94bc775e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032594 Aug 05 15:42:12.235459 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 502/1002] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:12.456784 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:12.457332 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:12.463818 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.464328 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.464767 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.465473 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.465925 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.466346 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.640199 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:12.647642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8d6a6676-c7d3-4b2a-83a9-d31e8f0cc85f tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1558 microversion: 2.1 time: 0.194885 Aug 05 15:42:12.648233 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 501/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:12 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1558 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:12.669050 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:12.669773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:12.674139 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:12.674748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:12.676544 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.677033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.677477 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.678176 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.678635 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.679064 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.680619 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.681652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.682086 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.682775 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.683230 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.683652 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.787145 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9afa0313-5600-43e5-aab0-27ec727e6994 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122814 Aug 05 15:42:12.787848 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 503/1004] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 15:42:12 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:12.793088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:12.793845 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:12.800289 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.800786 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.801227 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.801930 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:12.802388 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:12.802816 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:12.820875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:13.020667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:13.028608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b4c21b1a-f198-43f1-aa1d-c86547593d9d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1359 microversion: 2.1 time: 0.358099 Aug 05 15:42:13.042497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 502/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:12 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1359 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:13.101511 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:13.109000 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-39e7ab37-ff7f-4c3e-8803-b34990ef2d9d tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.320087 Aug 05 15:42:13.109606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 504/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:12 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:14.049722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:14.050327 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:14.057428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.058154 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.058589 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.059873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.059873 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.060190 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.133178 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:14.134935 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:14.142399 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.143695 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.144462 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.145549 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.146161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.146622 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.596759 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:14.605257 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-761e46ff-d56f-41c8-971b-03677c67f330 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1549 microversion: 2.1 time: 0.559425 Aug 05 15:42:14.620905 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 503/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:14 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1549 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:14.620905 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-537b49d3-4efc-453f-8c51-544ea15de129 req-360b0473-b542-4275-a251-10c22672f1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409a8b9a-dd6d-47de-9bae-db7fa17239e3", "tag": "ed67b356-a381-4fff-b159-68d2d2cfd2a2"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:14.620905 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-537b49d3-4efc-453f-8c51-544ea15de129 req-360b0473-b542-4275-a251-10c22672f1e3 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.620905 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-537b49d3-4efc-453f-8c51-544ea15de129 req-360b0473-b542-4275-a251-10c22672f1e3 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.621369 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-537b49d3-4efc-453f-8c51-544ea15de129 req-360b0473-b542-4275-a251-10c22672f1e3 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.632460 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-537b49d3-4efc-453f-8c51-544ea15de129 req-360b0473-b542-4275-a251-10c22672f1e3 service nova] Creating event network-changed:ed67b356-a381-4fff-b159-68d2d2cfd2a2 for instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 on hv-cinder-84989 Aug 05 15:42:14.637984 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-537b49d3-4efc-453f-8c51-544ea15de129 req-360b0473-b542-4275-a251-10c22672f1e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031049 Aug 05 15:42:14.638737 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 504/1008] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:14.643754 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:14.645602 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:14.652053 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.652714 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.653018 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.653718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.654172 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.654592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.687182 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=100 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:14.726925 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:14.736579 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-abc90531-773a-4ffa-91b2-fc376efc35f3 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.610233 Aug 05 15:42:14.738007 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 505/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:14 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:14.840266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:14.848608 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-cd98ae9d-57fe-45c3-9929-4f1b4e630c78 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1549 microversion: 2.1 time: 0.208759 Aug 05 15:42:14.863394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 505/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:14 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1549 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:14.870612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:14.877612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:14.877612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Searching by: {'deleted': False, 'project_id': '6e62e9372a7a47528e7973537bebbfb6'} {{(pid=118723) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 15:42:14.883473 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.883993 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.884469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.885196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:14.886190 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:14.886190 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:14.983322 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.multi_cell_list [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 15:42:15.083291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6028e9e1-6397-4c93-9571-9f4df0c67d14 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216932 Aug 05 15:42:15.084334 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 506/1011] 10.222.0.40 () {58 vars in 1125 bytes} [Fri Aug 5 15:42:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:15.096519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:15.097796 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:15.106664 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:15.107158 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:15.107593 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:15.108334 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:15.108784 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:15.109203 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:15.376552 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:15.385103 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-a2d7325a-ed5a-437f-80b9-35c34b90360d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1549 microversion: 2.1 time: 0.293243 Aug 05 15:42:15.386067 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 506/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:15 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1549 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:15.759735 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:15.760380 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:15.766709 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:15.767185 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:15.767616 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:15.768334 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:15.768789 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:15.769211 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:15.901744 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:15.909486 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fb02c931-9988-4ff1-96b8-0c7bd22c4071 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.154397 Aug 05 15:42:15.910047 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 507/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:15 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:16.937879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:16.938542 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:16.945006 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:16.945489 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:16.945923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:16.947121 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:16.947583 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:16.948009 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:17.078660 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:17.086349 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-fa11ecb2-b382-420b-8ebc-73b671a341ba tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.152393 Aug 05 15:42:17.087467 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 507/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:16 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:17.329188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09d64937-b49c-40cf-8554-d160efa2be23"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:17.331578 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:17.337721 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:17.341959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:17.341959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:17.341959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:17.341959 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:17.342491 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:18.078036 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-87981a20-c0d6-4a1b-9e1c-19dbcdf8789b tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "POST /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752651 Aug 05 15:42:18.078646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 508/1015] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:42:17 2022] POST /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:18.109086 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:18.109777 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:18.115815 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:18.116139 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:18.116580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:18.117278 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:18.117733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:18.118162 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:18.252834 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:18.261439 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-d4e7e0ca-bf72-4227-ac8f-fee91719d4ec tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1567 microversion: 2.1 time: 0.156393 Aug 05 15:42:18.261954 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 508/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:18 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:18.283566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:18.284597 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:18.291466 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:18.291957 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:18.292630 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:18.293373 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:18.293817 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:18.294245 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:18.337907 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118723) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 15:42:18.634472 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1b5da634-b06d-46e3-82eb-f5833fd96355 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "POST /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef/action" status: 202 len: 0 microversion: 2.1 time: 0.355164 Aug 05 15:42:18.635003 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 509/1017] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:42:18 2022] POST /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:42:18.643084 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:18.643691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:18.650575 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:18.651056 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:18.651487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:18.652214 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:18.652879 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:18.653084 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:18.790387 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:18.798630 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-b995203e-751e-44d9-af61-37a15c913aaa tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1515 microversion: 2.1 time: 0.159385 Aug 05 15:42:18.799475 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 509/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:18 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:19.822103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:19.822831 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:19.828743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:19.829231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:19.829666 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:19.830925 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:19.830925 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:19.831260 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:19.971851 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:19.979326 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-986d88d0-37a0-427e-bcb8-2f9a1f1a5d83 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1515 microversion: 2.1 time: 0.162565 Aug 05 15:42:19.979889 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 510/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:19 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:21.000633 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:21.001245 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:21.007891 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:21.008408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:21.008837 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:21.009570 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:21.010017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:21.010433 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:21.137082 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:21.144414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7013953c-3992-4633-b276-8a2ab286359f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1517 microversion: 2.1 time: 0.147672 Aug 05 15:42:21.144988 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 510/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:20 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:21.918394 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-60e9704a-d17a-4a2d-a076-0a0b2cf822a8 req-79c5c704-8379-4c5f-8dbc-0fa6668a5b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47d4294-a4d6-4950-b778-7e1947c6a8ef", "name": "network-vif-unplugged", "status": "completed", "tag": "1b2ba23a-8013-4633-b805-dfe87929d3df"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:21.928358 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-60e9704a-d17a-4a2d-a076-0a0b2cf822a8 req-79c5c704-8379-4c5f-8dbc-0fa6668a5b3e service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:21.928836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-60e9704a-d17a-4a2d-a076-0a0b2cf822a8 req-79c5c704-8379-4c5f-8dbc-0fa6668a5b3e service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:21.929271 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-60e9704a-d17a-4a2d-a076-0a0b2cf822a8 req-79c5c704-8379-4c5f-8dbc-0fa6668a5b3e service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:21.940498 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.compute.server_external_events [req-60e9704a-d17a-4a2d-a076-0a0b2cf822a8 req-79c5c704-8379-4c5f-8dbc-0fa6668a5b3e service nova] Unable to find a host for instance c47d4294-a4d6-4950-b778-7e1947c6a8ef. Dropping event network-vif-unplugged {{(pid=118723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 15:42:21.941372 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-60e9704a-d17a-4a2d-a076-0a0b2cf822a8 req-79c5c704-8379-4c5f-8dbc-0fa6668a5b3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026920 Aug 05 15:42:21.941937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 511/1021] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 15:42:22.166361 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:22.166876 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:22.173761 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:22.174245 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:22.174679 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:22.175380 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:22.175835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:22.176287 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:22.310013 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:22.317461 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ac8c9de7-8feb-4301-9190-eaf3847bd2ac tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1517 microversion: 2.1 time: 0.155568 Aug 05 15:42:22.318042 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 511/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:22 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:23.338299 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:23.338912 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:23.345378 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:23.345858 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:23.346293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:23.346986 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:23.347438 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:23.347862 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:23.474859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:23.482293 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-3412b60a-682c-4d13-8fd2-3d1e2b3f9204 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1517 microversion: 2.1 time: 0.147858 Aug 05 15:42:23.482860 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 512/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:23 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:24.503858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:24.504495 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:24.511828 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:24.512332 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:24.512792 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:24.513472 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:24.513917 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:24.514333 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:24.644772 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:24.652928 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c6789e15-d515-4638-92ce-f9e8854e2e86 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1517 microversion: 2.1 time: 0.152963 Aug 05 15:42:24.653483 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 512/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:24 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:25.657555 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:25.658169 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:25.660646 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell0:SELECT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:25.665349 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:25.671663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:25.671663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:25.671663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:25.671663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:25.672154 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:25.673696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:25.674315 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:25.680648 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:25.681140 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:25.682122 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:25.682808 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:25.683321 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:25.683829 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:25.861021 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:25.869424 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-f67ee12c-62f0-49d2-91c0-b856394dae81 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1595 microversion: 2.1 time: 0.215381 Aug 05 15:42:25.870196 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 513/1025] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:25 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1595 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:25.877710 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:25.885810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-eb02bff4-44b9-4eea-864b-65bf56e4215c tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1517 microversion: 2.1 time: 0.216106 Aug 05 15:42:25.886389 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 513/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:25 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1517 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:26.908134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:26.908802 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:26.915567 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:26.916759 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:26.917199 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:26.917915 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:26.918373 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:26.918870 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:27.151602 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:27.160121 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8ce16090-15c7-4b1d-921d-62c564ac5d8f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.256474 Aug 05 15:42:27.160639 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 514/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:26 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:28.111883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-c404efef-0c1d-4568-972a-538c90ddc1e3 req-bf96cb7b-4004-4d89-8450-76d59798ac3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f4ac26-5bea-44a0-9a56-8f33e3006c10", "tag": "48995f61-b1de-411b-9621-65e545d953f7"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:28.122810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c404efef-0c1d-4568-972a-538c90ddc1e3 req-bf96cb7b-4004-4d89-8450-76d59798ac3b service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:28.123386 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c404efef-0c1d-4568-972a-538c90ddc1e3 req-bf96cb7b-4004-4d89-8450-76d59798ac3b service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:28.123887 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-c404efef-0c1d-4568-972a-538c90ddc1e3 req-bf96cb7b-4004-4d89-8450-76d59798ac3b service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:28.135223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-c404efef-0c1d-4568-972a-538c90ddc1e3 req-bf96cb7b-4004-4d89-8450-76d59798ac3b service nova] Creating event network-changed:48995f61-b1de-411b-9621-65e545d953f7 for instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 on hv-cinder-84989 Aug 05 15:42:28.140340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-c404efef-0c1d-4568-972a-538c90ddc1e3 req-bf96cb7b-4004-4d89-8450-76d59798ac3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Aug 05 15:42:28.140979 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 514/1028] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:28.181895 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:28.182509 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:28.189193 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:28.189916 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:28.190360 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:28.191042 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:28.191965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:28.192578 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:28.469095 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:28.477168 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-44f27dbe-1451-41a7-aa21-f7933c306b73 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.299707 Aug 05 15:42:28.478188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 515/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:28 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:29.499135 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:29.499974 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:29.506340 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:29.506916 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:29.507386 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:29.508112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:29.508578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:29.509004 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:29.642979 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:29.651342 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-83bff87f-2477-47a7-9ffb-84c6ea55bee9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.156892 Aug 05 15:42:29.651903 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 515/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:29 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:30.672815 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:30.673433 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:30.679774 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:30.680301 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:30.680748 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:30.681441 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:30.681897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:30.682854 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:30.815866 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:30.824170 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c5a62f5f-4732-41a4-8c05-0217e0889042 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.155276 Aug 05 15:42:30.824949 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 516/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:30 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:31.461364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-164500704"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:31.466039 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:31.468817 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:31.469292 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:31.469718 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:31.470419 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:31.470865 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:31.471283 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:31.600787 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.network.security_group_api [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Adding security group 7eedca7b-0c56-4959-88d8-5214c9d4e950 to port 48995f61-b1de-411b-9621-65e545d953f7 Aug 05 15:42:31.846297 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:31.846902 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:31.853232 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:31.853649 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:31.854114 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:31.854803 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:31.855251 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:31.855667 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:31.977191 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-233e7188-fb0b-4850-a7eb-1315ce820331 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "POST /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/action" status: 202 len: 0 microversion: 2.1 time: 0.518747 Aug 05 15:42:31.977954 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 516/1032] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:42:31 2022] POST /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:42:31.986421 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:31.987029 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:31.993397 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:31.993867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:31.994574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:31.995274 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:31.995733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:31.996335 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:32.051911 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:32.061328 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-5538fa40-6c84-4fca-adbe-5ba71951f8b0 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.218517 Aug 05 15:42:32.072089 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 517/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:31 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:32.072089 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-32e17dd4-476c-4bda-b302-2dc08b3c09c3 req-c1b17ff3-1bfe-4cbb-9bd0-d551b0cd59fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f4ac26-5bea-44a0-9a56-8f33e3006c10", "tag": "48995f61-b1de-411b-9621-65e545d953f7"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:32.077017 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:32.080836 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-32e17dd4-476c-4bda-b302-2dc08b3c09c3 req-c1b17ff3-1bfe-4cbb-9bd0-d551b0cd59fd service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:32.086206 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-32e17dd4-476c-4bda-b302-2dc08b3c09c3 req-c1b17ff3-1bfe-4cbb-9bd0-d551b0cd59fd service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:32.086206 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-32e17dd4-476c-4bda-b302-2dc08b3c09c3 req-c1b17ff3-1bfe-4cbb-9bd0-d551b0cd59fd service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:32.098989 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-32e17dd4-476c-4bda-b302-2dc08b3c09c3 req-c1b17ff3-1bfe-4cbb-9bd0-d551b0cd59fd service nova] Creating event network-changed:48995f61-b1de-411b-9621-65e545d953f7 for instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 on hv-cinder-84989 Aug 05 15:42:32.105130 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-32e17dd4-476c-4bda-b302-2dc08b3c09c3 req-c1b17ff3-1bfe-4cbb-9bd0-d551b0cd59fd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041906 Aug 05 15:42:32.105932 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 518/1034] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:32.220606 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:32.230315 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9ed5bef5-1457-425f-ac9c-d5415b8bdefe tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1760 microversion: 2.1 time: 0.248509 Aug 05 15:42:32.231318 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 517/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:31 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1760 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:33.086669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:33.087367 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:33.094468 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:33.094971 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:33.095441 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:33.096167 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:33.096746 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:33.100139 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:33.225828 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:33.229958 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:33.234290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6e9f6b48-6445-4c05-833c-356b2c534f0e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.152758 Aug 05 15:42:33.234852 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 519/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:33 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:34.255142 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:34.255742 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:34.262047 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:34.262521 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:34.262950 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:34.263626 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:34.264092 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:34.264511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:34.392819 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:34.400180 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-486e5a52-3054-4c89-94d0-18b24aef9560 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.148874 Aug 05 15:42:34.401250 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 518/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:34 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:35.421954 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:35.422604 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:35.429647 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:35.430134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:35.430574 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:35.431269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:35.431724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:35.432727 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:35.565084 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:35.572599 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8e36fbce-6cad-46dc-a90e-53a5627e8c50 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.154464 Aug 05 15:42:35.573625 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 520/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:35 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:36.594276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:36.594896 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:36.602733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:36.603247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:36.603910 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:36.604830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:36.605278 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:36.609098 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:36.735423 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:36.742913 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-df292b0e-8d4e-42a2-9747-cf6ad2429588 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.152620 Aug 05 15:42:36.743480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 519/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:36 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:37.764790 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:37.765398 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:37.771802 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:37.772312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:37.772746 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:37.773426 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:37.773874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:37.774292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:37.913197 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:37.921007 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1836f3e1-0180-4130-9540-0a307b73fe91 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.160576 Aug 05 15:42:37.922199 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 521/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:37 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:38.038571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-307e052a-4ca9-4167-bd2c-3bbdb2a638f0 req-c64c5f47-1117-4fac-acc8-5314138aa86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47d4294-a4d6-4950-b778-7e1947c6a8ef", "name": "network-vif-plugged", "status": "completed", "tag": "1b2ba23a-8013-4633-b805-dfe87929d3df"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:38.044578 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=49 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:38.049764 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-307e052a-4ca9-4167-bd2c-3bbdb2a638f0 req-c64c5f47-1117-4fac-acc8-5314138aa86a service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:38.050231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-307e052a-4ca9-4167-bd2c-3bbdb2a638f0 req-c64c5f47-1117-4fac-acc8-5314138aa86a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:38.050867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-307e052a-4ca9-4167-bd2c-3bbdb2a638f0 req-c64c5f47-1117-4fac-acc8-5314138aa86a service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:38.061574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-307e052a-4ca9-4167-bd2c-3bbdb2a638f0 req-c64c5f47-1117-4fac-acc8-5314138aa86a service nova] Creating event network-vif-plugged:1b2ba23a-8013-4633-b805-dfe87929d3df for instance c47d4294-a4d6-4950-b778-7e1947c6a8ef on hv-cinder-84989 Aug 05 15:42:38.066635 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-307e052a-4ca9-4167-bd2c-3bbdb2a638f0 req-c64c5f47-1117-4fac-acc8-5314138aa86a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031798 Aug 05 15:42:38.067541 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 520/1041] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:38.945564 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:38.946185 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:38.952638 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:38.953123 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:38.953563 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:38.954258 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:38.954715 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:38.955141 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:39.083657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:39.090534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-bdcaeea6-6b3e-465d-885f-c94614db036e tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1573 microversion: 2.1 time: 0.148906 Aug 05 15:42:39.091103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 522/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:38 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:40.113413 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:40.114100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:40.121243 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:40.121723 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:40.122152 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:40.122831 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:40.123276 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:40.123731 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:40.266300 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:40.273915 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5989e1f4-96db-4165-96cc-5fdbde0b52e4 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1560 microversion: 2.1 time: 0.165133 Aug 05 15:42:40.274489 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 521/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:40 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:48.198198 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:48.198198 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:48.200846 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:48.201662 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:48.202439 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:48.203482 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:48.204340 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:48.205104 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:48.386135 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-24c38960-ce20-44b4-96a4-c826d7f48f3d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "POST /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/action" status: 202 len: 0 microversion: 2.1 time: 0.198691 Aug 05 15:42:48.386750 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 523/1044] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:42:48 2022] POST /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:42:48.395240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:48.395847 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:48.401992 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:48.402464 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:48.402890 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:48.403580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:48.404030 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:48.404480 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:48.407382 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=89 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:42:48.591699 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:48.599560 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ac056b04-720c-4a10-b06f-7976b5890567 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1752 microversion: 2.1 time: 0.208526 Aug 05 15:42:48.600140 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 522/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:48 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1752 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:49.623067 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:49.623760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:49.629818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:49.630290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:49.630722 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:49.631401 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:49.631847 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:49.632291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:49.773695 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:49.781747 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-e5126940-519f-4309-a3dd-b81bd820bc12 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.163793 Aug 05 15:42:49.782580 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 524/1046] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:49 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:50.359474 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:50.360083 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:50.366395 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:50.366867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:50.367295 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:50.367972 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:50.368441 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:50.368858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:50.390943 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-ab581fa9-1098-41e8-9d72-277f46c9b7b9 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/ips" status: 200 len: 149 microversion: 2.1 time: 0.035992 Aug 05 15:42:50.391494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 523/1047] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 15:42:50 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:50.803144 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:50.803755 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:50.810118 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:50.810595 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:50.811028 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:50.811946 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:50.812193 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:50.812618 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:50.967361 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:50.975787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fd2c18c9-5b5b-4b9c-9a8e-f4b74e9a57b0 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.176382 Aug 05 15:42:50.976780 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 525/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:50 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:51.981011 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a90da650-3993-4d18-8fb3-6b0062a08d9f"}} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:42:51.983574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:51.989545 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:51.990028 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:51.990461 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:51.991146 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:51.991596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:51.992017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:52.000452 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:52.001088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:52.007336 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:52.007825 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:52.008688 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:52.008999 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:52.009458 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:52.009891 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:52.154887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:52.163134 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9b85c9d8-1fe9-4234-afd3-8a516e0ba3d6 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.166712 Aug 05 15:42:52.163726 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 526/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:51 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:42:52.710032 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-8095f8a7-b06c-4589-bcf0-24d182f6bdb2 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "POST /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733183 Aug 05 15:42:52.710633 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 524/1050] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 15:42:51 2022] POST /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:42:53.184373 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:53.184987 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:53.191415 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:53.191897 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:53.192360 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:53.193083 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:53.193534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:53.193960 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:53.336291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:53.344731 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0825a077-e3a0-41e6-9e03-1abc86cd431e tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.164311 Aug 05 15:42:53.345291 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 527/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:53 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:54.368176 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:54.368866 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:54.375537 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:54.376013 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:54.376494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:54.377175 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:54.377624 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:54.378044 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:54.515763 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:54.523883 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-0bcbe26c-1d9f-4024-831d-7cdf7f4600ac tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.160407 Aug 05 15:42:54.524468 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 525/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:54 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:55.546659 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:55.547272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:55.553629 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:55.554108 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:55.554543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:55.555236 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:55.555689 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:55.556136 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:55.696578 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:55.704951 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8530225b-e3bb-4c35-ad49-ed5c62054ebc tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.162748 Aug 05 15:42:55.705501 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 528/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:55 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:56.726574 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:56.727180 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:56.733515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:56.733987 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:56.734417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:56.735095 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:56.735540 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:56.735957 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:56.873445 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:56.881316 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-df8dd2ac-5543-4af0-b088-51da3df3711f tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.158596 Aug 05 15:42:56.881875 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 526/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:56 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:57.903547 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:57.904200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:57.910859 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:57.911344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:57.911781 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:57.912511 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:57.912972 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:57.913398 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:58.056683 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:58.064818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-1b76587e-8e89-41c7-9cd6-1ee57866cffb tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.165679 Aug 05 15:42:58.065382 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 529/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:57 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:42:59.086620 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:42:59.087258 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:42:59.093750 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:59.094260 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:59.094622 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:59.095331 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:42:59.095748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:42:59.096194 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:42:59.237465 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:42:59.245952 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-1c757029-1c9c-4336-8ae0-db8659897f72 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.162732 Aug 05 15:42:59.246528 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 527/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:42:59 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:43:00.268524 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:00.269383 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:00.279083 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:00.279572 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:00.280016 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:00.280782 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:00.281233 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:00.281658 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:00.344143 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:00.344715 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:00.351221 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:00.351963 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:00.354744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:00.354744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:00.354744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:00.354744 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:00.429606 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:43:00.435136 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.objects.instance [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lazy-loading 'services' on Instance uuid 409a8b9a-dd6d-47de-9bae-db7fa17239e3 {{(pid=118722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:43:00.437698 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-20668076-1a75-4f81-be69-d52f7e4d3a01 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1757 microversion: 2.1 time: 0.173329 Aug 05 15:43:00.438290 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 530/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:00 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 15:43:00.650971 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-120b0f42-86f2-4519-9214-4fe2ea9297bb tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-volume_attachments/a90da650-3993-4d18-8fb3-6b0062a08d9f" status: 202 len: 0 microversion: 2.1 time: 0.311191 Aug 05 15:43:00.651484 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 528/1058] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:43:00 2022] DELETE /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-volume_attachments/a90da650-3993-4d18-8fb3-6b0062a08d9f => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 15:43:00.660093 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:00.662292 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:00.668222 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:00.668716 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:00.669132 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:00.669818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:00.670263 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:00.670681 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:00.700242 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fb75596f-ad34-400b-970e-bf246324d875 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Aug 05 15:43:00.700788 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 531/1059] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:43:00 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:43:01.460523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:01.461148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:01.467722 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:01.468240 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:01.468675 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:01.469363 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:01.469867 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:01.470295 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:01.615462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:43:01.623688 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-da70c776-495e-4fe6-acf1-3a04cc488ea3 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1760 microversion: 2.1 time: 0.168055 Aug 05 15:43:01.624418 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 529/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:01 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:43:01.712594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:01.715269 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:01.721669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:01.722152 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:01.722594 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:01.723341 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:01.723799 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:01.724265 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:01.752042 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-596d99d2-a95c-4375-9a56-86cd6eba9b7d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043463 Aug 05 15:43:01.752611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 532/1061] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:43:01 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 15:43:01.812527 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:01.813023 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:01.818821 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:01.819301 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:01.819733 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:01.820448 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:01.820901 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:01.821321 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:01.846086 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:43:02.125723 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-7b50699d-d92b-4674-bf2d-2729e351f0ac tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 204 len: 0 microversion: 2.1 time: 0.316658 Aug 05 15:43:02.126324 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 530/1062] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:43:01 2022] DELETE /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:43:02.134397 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:02.137743 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:02.141669 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:02.142155 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:02.142592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:02.143283 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:02.143737 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:02.144188 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:02.273527 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:43:02.280980 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-360e056c-8471-4fa1-b6f1-b1bffeaf5925 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1682 microversion: 2.1 time: 0.150467 Aug 05 15:43:02.281536 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 533/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:02 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:43:03.302322 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:03.303010 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:03.309982 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:03.310454 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:03.310884 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:03.311562 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:03.312017 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:03.312592 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:03.697515 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:43:03.705708 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-65a0b70a-c333-41a5-bac1-a489208a364b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1682 microversion: 2.1 time: 0.407581 Aug 05 15:43:03.706272 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 531/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:03 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1682 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:43:04.685736 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-ce907c7e-bafe-4a85-913f-467393ed5d19 req-b38bef55-3957-4ed2-a4ef-79a9fde02598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409a8b9a-dd6d-47de-9bae-db7fa17239e3", "name": "network-vif-deleted", "tag": "ed67b356-a381-4fff-b159-68d2d2cfd2a2"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:43:04.691109 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=32 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:04.703456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-ce907c7e-bafe-4a85-913f-467393ed5d19 req-b38bef55-3957-4ed2-a4ef-79a9fde02598 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:04.703456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-ce907c7e-bafe-4a85-913f-467393ed5d19 req-b38bef55-3957-4ed2-a4ef-79a9fde02598 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:04.703456 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-ce907c7e-bafe-4a85-913f-467393ed5d19 req-b38bef55-3957-4ed2-a4ef-79a9fde02598 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:04.708773 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-ce907c7e-bafe-4a85-913f-467393ed5d19 req-b38bef55-3957-4ed2-a4ef-79a9fde02598 service nova] Creating event network-vif-deleted:ed67b356-a381-4fff-b159-68d2d2cfd2a2 for instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 on hv-cinder-84989 Aug 05 15:43:04.714185 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-ce907c7e-bafe-4a85-913f-467393ed5d19 req-b38bef55-3957-4ed2-a4ef-79a9fde02598 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032468 Aug 05 15:43:04.715107 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 534/1065] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:43:04.727408 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:04.728034 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:04.741992 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:04.742517 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:04.742955 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:04.743748 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:04.744266 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:04.744693 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:04.820666 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5c43d63a754eeaaba429f5c8153bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c77da48edba4903a1c51fee2a856167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:43:04.829871 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e88ddb2f-6d87-4657-83d1-ebe947990ac7 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 200 len: 1614 microversion: 2.1 time: 0.106647 Aug 05 15:43:04.830786 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 532/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:04 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 1614 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:43:05.851375 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:05.852103 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:05.858971 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:05.859457 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:05.859895 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:05.860636 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:05.861077 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:05.861505 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:05.865415 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:05.874766 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 HTTP/1.1 Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:43:05.876404 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:05.878146 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '409a8b9a-dd6d-47de-9bae-db7fa17239e3'} Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:05.878998 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:05.880569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:05.882033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:05.882033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-06f95d16-237a-49dc-86fa-4fb7aef04f7b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 404 len: 111 microversion: 2.1 time: 0.030711 Aug 05 15:43:05.882033 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 535/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:05 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 15:43:05.887414 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-dde92cca-fd3b-4a9e-bede-2c95d23d5f85 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '.version_select at 0x7fcb14d26310>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:05.960364 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-dde92cca-fd3b-4a9e-bede-2c95d23d5f85 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356995811" status: 202 len: 0 microversion: 2.1 time: 0.077254 Aug 05 15:43:05.960862 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 533/1068] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 5 15:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356995811 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:43:08.065708 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:08.066200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:08.073153 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:08.073630 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:08.074064 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:08.074777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:08.075246 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:08.075654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:08.088520 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: DELETE /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 HTTP/1.1 Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:43:08.090569 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.091965 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '409a8b9a-dd6d-47de-9bae-db7fa17239e3'} Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:08.093887 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.095612 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.096955 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:08.096955 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8327ae62-941f-41a5-813a-00a09a1ac306 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 404 len: 111 microversion: 2.1 time: 0.030046 Aug 05 15:43:08.096955 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 536/1069] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:43:08 2022] DELETE /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:08.102136 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:08.102846 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 409a8b9a-dd6d-47de-9bae-db7fa17239e3] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:08.110100 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:08.110580 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:08.112101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:08.112101 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:08.112317 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:08.112667 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:08.125933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 HTTP/1.1 Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:43:08.127591 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.129220 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '409a8b9a-dd6d-47de-9bae-db7fa17239e3'} Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:08.130091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. Aug 05 15:43:08.131339 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:08.132501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 409a8b9a-dd6d-47de-9bae-db7fa17239e3 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:08.132501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-c6557083-8e01-4c63-a3dc-1234ba5567f4 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3" status: 404 len: 111 microversion: 2.1 time: 0.031324 Aug 05 15:43:08.132501 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 534/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:08 2022] GET /compute/v2.1/servers/409a8b9a-dd6d-47de-9bae-db7fa17239e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:09.370777 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:09.371272 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:09.378903 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:09.379379 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:09.379814 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:09.380534 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:09.380985 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:09.381400 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:09.394195 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: DELETE /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b HTTP/1.1 Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:43:09.395697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.399810 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '98fdfc63-b5ab-461d-a014-ea82d1d65b0b'} Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:09.400879 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.402471 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.404031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:09.404031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-529bf331-2a1d-493d-ab29-23836c617272 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 404 len: 111 microversion: 2.1 time: 0.030438 Aug 05 15:43:09.404031 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 537/1071] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:43:09 2022] DELETE /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:09.405692 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:09.406293 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 98fdfc63-b5ab-461d-a014-ea82d1d65b0b] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:09.413096 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:09.413567 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:09.413993 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:09.414707 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:09.415153 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:09.415571 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:09.429269 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b HTTP/1.1 Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:43:09.430771 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.432427 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '98fdfc63-b5ab-461d-a014-ea82d1d65b0b'} Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:09.433519 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. Aug 05 15:43:09.435642 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.437148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 98fdfc63-b5ab-461d-a014-ea82d1d65b0b could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:09.437148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-802d9f01-1cf2-4e8e-82e3-eb2a6c220f32 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b" status: 404 len: 111 microversion: 2.1 time: 0.030530 Aug 05 15:43:09.437148 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 535/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:09 2022] GET /compute/v2.1/servers/98fdfc63-b5ab-461d-a014-ea82d1d65b0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 15:43:09.441531 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:09.442162 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:09.448180 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:09.448660 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:09.449092 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:09.449779 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:09.450231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:09.450657 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:09.463504 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: DELETE /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca HTTP/1.1 Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:43:09.465048 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.466632 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '59fb549a-27e1-4a42-b47c-1f04bd4d23ca'} Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:09.467517 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.469075 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.470395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:09.470395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-c6093c1d-c5f3-4c41-97cd-42c504930365 tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 404 len: 111 microversion: 2.1 time: 0.029104 Aug 05 15:43:09.470395 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 538/1073] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:43:09 2022] DELETE /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:09.474299 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:09.474900 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 59fb549a-27e1-4a42-b47c-1f04bd4d23ca] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:09.480669 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:09.481681 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:09.482109 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:09.482780 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:09.483226 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:09.483640 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:09.497310 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca HTTP/1.1 Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:43:09.498835 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.500553 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '59fb549a-27e1-4a42-b47c-1f04bd4d23ca'} Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:09.501513 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. Aug 05 15:43:09.503107 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:09.504565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 59fb549a-27e1-4a42-b47c-1f04bd4d23ca could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:09.504565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-4678a52f-972a-473a-8329-b0cb40006b7e tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca" status: 404 len: 111 microversion: 2.1 time: 0.029581 Aug 05 15:43:09.504565 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 536/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:09 2022] GET /compute/v2.1/servers/59fb549a-27e1-4a42-b47c-1f04bd4d23ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:10.742469 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:10.742973 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:10.749352 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:10.749829 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:10.750288 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:10.750973 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:10.751425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:10.751849 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:10.765875 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: DELETE /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 HTTP/1.1 Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:43:10.767392 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.768874 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'id': '5f435a35-7760-4b03-8d2e-6f40df5f5714'} Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:10.769654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.771158 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.772697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:10.772697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8f5efe6f-ab0a-4d1d-a89e-6c58d957b82b tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 404 len: 111 microversion: 2.1 time: 0.030137 Aug 05 15:43:10.772697 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 539/1075] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:43:10 2022] DELETE /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:10.777109 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:10.777715 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] [instance: 5f435a35-7760-4b03-8d2e-6f40df5f5714] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:10.780810 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:10.785700 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:10.786172 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:10.786596 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:10.787273 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:10.787724 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:10.788167 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:10.801157 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] HTTP exception thrown: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Request method failure captured: Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 HTTP/1.1 Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TleJQOOzDU7ohHjGyhDff_NCJQc7e40xHLhfUsMruUi1G-OhYr7Ea_U2Hd4cDOUvaXjW6zs2YinxUCArfD13ZEaQhxV5ioVRMY_pWTmGsXEgdZmQN6K5lUCgKbjidDRIiApBkrJCKCkfw2K-WW-NM3CMg2GrjAsTRemkX8jJcaFcYI Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:43:10.802694 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c77da48edba4903a1c51fee2a856167", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c77da48edba4903a1c51fee2a856167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c77da48edba4903a1c51fee2a856167"}]}] Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 2c77da48edba4903a1c51fee2a856167 Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213729793 Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: dd5c43d63a754eeaaba429f5c8153bba Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-AttachVolumeNegativeTest-213729793-project Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.804223 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '5f435a35-7760-4b03-8d2e-6f40df5f5714'} Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:10.805302 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. Aug 05 15:43:10.806807 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:10.808462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] Returning 404 to user: Instance 5f435a35-7760-4b03-8d2e-6f40df5f5714 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:10.808462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-e1a9af7b-06b1-49e8-8ab8-89f5f818d58d tempest-AttachVolumeNegativeTest-213729793 tempest-AttachVolumeNegativeTest-213729793-project] 10.222.0.40 "GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714" status: 404 len: 111 microversion: 2.1 time: 0.030774 Aug 05 15:43:10.808462 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 537/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:10 2022] GET /compute/v2.1/servers/5f435a35-7760-4b03-8d2e-6f40df5f5714 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:34.233529 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-164500704"}} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:43:34.234724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:34.236980 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=11 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:34.237633 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=9 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:34.242218 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:34.247603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:34.247603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:34.247603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:34.247603 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:34.248002 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:34.381715 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.network.security_group_api [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Removing security group 7eedca7b-0c56-4959-88d8-5214c9d4e950 from port 48995f61-b1de-411b-9621-65e545d953f7 Aug 05 15:43:35.038123 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-6a5d889f-e831-4aa7-9d91-19c85eb55293 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "POST /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/action" status: 202 len: 0 microversion: 2.1 time: 0.805555 Aug 05 15:43:35.039025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 540/1077] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 15:43:34 2022] POST /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:43:35.049445 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-54632f8d-db35-4b08-aca8-52df28d94cdc req-cf41ccf8-aa2c-4ac5-b5ec-43a744d3856e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f4ac26-5bea-44a0-9a56-8f33e3006c10", "tag": "48995f61-b1de-411b-9621-65e545d953f7"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:43:35.058713 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:35.063999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-54632f8d-db35-4b08-aca8-52df28d94cdc req-cf41ccf8-aa2c-4ac5-b5ec-43a744d3856e service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:35.063999 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-54632f8d-db35-4b08-aca8-52df28d94cdc req-cf41ccf8-aa2c-4ac5-b5ec-43a744d3856e service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:35.065224 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-54632f8d-db35-4b08-aca8-52df28d94cdc req-cf41ccf8-aa2c-4ac5-b5ec-43a744d3856e service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:35.084550 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-54632f8d-db35-4b08-aca8-52df28d94cdc req-cf41ccf8-aa2c-4ac5-b5ec-43a744d3856e service nova] Creating event network-changed:48995f61-b1de-411b-9621-65e545d953f7 for instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 on hv-cinder-84989 Aug 05 15:43:35.092673 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-54632f8d-db35-4b08-aca8-52df28d94cdc req-cf41ccf8-aa2c-4ac5-b5ec-43a744d3856e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047181 Aug 05 15:43:35.094091 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 538/1078] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:43:36.538982 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:36.539592 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:36.545757 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:36.546802 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:36.547241 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:36.547947 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:36.548429 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:36.548852 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:36.636286 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lazy-loading 'services' on Instance uuid 84f4ac26-5bea-44a0-9a56-8f33e3006c10 {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:43:36.856193 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-8d6b76e0-6532-4e13-ad3c-6723859854fa tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "DELETE /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments/09d64937-b49c-40cf-8554-d160efa2be23" status: 202 len: 0 microversion: 2.1 time: 0.321904 Aug 05 15:43:36.856749 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 541/1079] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:43:36 2022] DELETE /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments/09d64937-b49c-40cf-8554-d160efa2be23 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:43:36.867791 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:36.870103 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:36.878755 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:36.879247 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:36.879687 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:36.880449 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:36.880868 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:36.881291 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:36.919374 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-587f3a9e-e92f-42fa-bf47-a4e93fe552bf tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056354 Aug 05 15:43:36.920178 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 539/1080] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:43:36 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:43:37.111091 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-cda4cf43-fc8a-4754-9abe-8937f515545a req-8fe90ff1-b8d5-4925-8936-c5490afc3470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f4ac26-5bea-44a0-9a56-8f33e3006c10", "tag": "48995f61-b1de-411b-9621-65e545d953f7"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:43:37.126736 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cda4cf43-fc8a-4754-9abe-8937f515545a req-8fe90ff1-b8d5-4925-8936-c5490afc3470 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:37.127565 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cda4cf43-fc8a-4754-9abe-8937f515545a req-8fe90ff1-b8d5-4925-8936-c5490afc3470 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:37.128344 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-cda4cf43-fc8a-4754-9abe-8937f515545a req-8fe90ff1-b8d5-4925-8936-c5490afc3470 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:37.141775 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-cda4cf43-fc8a-4754-9abe-8937f515545a req-8fe90ff1-b8d5-4925-8936-c5490afc3470 service nova] Creating event network-changed:48995f61-b1de-411b-9621-65e545d953f7 for instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 on hv-cinder-84989 Aug 05 15:43:37.147168 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-cda4cf43-fc8a-4754-9abe-8937f515545a req-8fe90ff1-b8d5-4925-8936-c5490afc3470 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040329 Aug 05 15:43:37.147763 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 542/1081] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:43:37.931310 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:37.933494 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:37.942207 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:37.942689 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:37.943124 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:37.944782 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:37.945241 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:37.945665 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:37.977232 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-80536a6a-1bdb-494f-a2e3-a6a176e5f586 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049936 Aug 05 15:43:37.978038 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 540/1082] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 15:43:37 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 15:43:37.990115 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:37.990818 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:37.997172 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:38.000220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:38.000220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:38.000220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:38.000220 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:38.000676 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:38.077538 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.wsgi [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] HTTP exception thrown: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 is not attached to volume 09d64937-b49c-40cf-8554-d160efa2be23 Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Request method failure captured: Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: request: DELETE /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments/09d64937-b49c-40cf-8554-d160efa2be23 HTTP/1.1 Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept: application/json Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Accept-Encoding: identity Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Connection: close Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Length: 0 Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Content-Type: application/json Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Host: 10.222.0.40 Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Openstack-System-Scope: None Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Auth-Token: gAAAAABi7TotJgANiQSc_LiWRegVCj0e0k_oizT696a49-YGK1jZ4Hw9NCS8vFO49a0TI5q9djjSMhSsEt-n9kATJtLahP_NxyrVbbAeYVHMLHFmzhqFmsAU9M28y3qhHi7-kXRHHInkLOQzLZvJcIHX1GC1LEg69mezgOlu-k659Pkj89GqAE8 Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Id: None Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Domain-Name: None Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Identity-Status: Confirmed Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Is-Admin-Project: True Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Id: default Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Domain-Name: Default Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Id: 6e62e9372a7a47528e7973537bebbfb6 Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Project-Name: tempest-TestMinimumBasicScenario-1826098860 Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Role: reader,member Aug 05 15:43:38.080425 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Roles: reader,member Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e62e9372a7a47528e7973537bebbfb6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e62e9372a7a47528e7973537bebbfb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e62e9372a7a47528e7973537bebbfb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e62e9372a7a47528e7973537bebbfb6"}]}] Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant: tempest-TestMinimumBasicScenario-1826098860 Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Id: 6e62e9372a7a47528e7973537bebbfb6 Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1826098860 Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User: tempest-TestMinimumBasicScenario-1826098860-project Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Id: default Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Domain-Name: Default Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Id: 8ffd179bd4a445eaafb53d7accede863 Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: X-User-Name: tempest-TestMinimumBasicScenario-1826098860-project Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: method: > Aug 05 15:43:38.082230 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: exception: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 is not attached to volume 09d64937-b49c-40cf-8554-d160efa2be23 Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: action_args: {'server_id': '84f4ac26-5bea-44a0-9a56-8f33e3006c10', 'id': '09d64937-b49c-40cf-8554-d160efa2be23'} Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 09d64937-b49c-40cf-8554-d160efa2be23. Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:38.083231 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 is not attached to volume 09d64937-b49c-40cf-8554-d160efa2be23 Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 is not attached to volume 09d64937-b49c-40cf-8554-d160efa2be23 Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: ERROR nova.api.openstack.wsgi Aug 05 15:43:38.084765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Returning 404 to user: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 is not attached to volume 09d64937-b49c-40cf-8554-d160efa2be23 {{(pid=118723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:38.085981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-05418c31-0902-4774-9e31-21fc0f0d3f20 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "DELETE /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments/09d64937-b49c-40cf-8554-d160efa2be23" status: 404 len: 154 microversion: 2.1 time: 0.096154 Aug 05 15:43:38.085981 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 543/1083] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 15:43:37 2022] DELETE /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10/os-volume_attachments/09d64937-b49c-40cf-8554-d160efa2be23 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:39.371081 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:39.371634 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:39.379112 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:39.379589 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:39.380324 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:39.380798 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:39.381246 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:39.381684 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:39.405433 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:43:39.725417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-944d9af5-1733-4520-90d5-fed2f5cd8ca4 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "DELETE /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 204 len: 0 microversion: 2.1 time: 0.357981 Aug 05 15:43:39.726008 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 541/1084] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:43:39 2022] DELETE /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:43:39.735047 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:39.735663 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:39.743451 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:39.743941 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:39.744432 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:39.745160 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:39.745611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:39.746180 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:39.875618 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:43:39.883088 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-65941f16-fa54-429f-87ec-42764e2f22ad tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1555 microversion: 2.1 time: 0.152781 Aug 05 15:43:39.883636 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 544/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:39 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:43:40.905368 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:40.906071 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:40.912889 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:40.913373 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:40.913841 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:40.914563 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:40.915018 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:40.915440 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:41.050391 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:43:41.058721 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-92a8e682-6244-45d2-9ed3-e1b753c39802 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1555 microversion: 2.1 time: 0.157477 Aug 05 15:43:41.060986 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 542/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:40 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:43:42.081702 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:42.082322 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:42.089948 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:42.094025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:42.094025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:42.094025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:42.094025 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:42.094427 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:42.129739 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [req-7091e19d-c2df-4207-8914-0e3a7a4431c7 req-2e854adc-44be-41f7-b50e-298732eef831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f4ac26-5bea-44a0-9a56-8f33e3006c10", "name": "network-vif-deleted", "tag": "48995f61-b1de-411b-9621-65e545d953f7"}]} {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:43:42.139497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-7091e19d-c2df-4207-8914-0e3a7a4431c7 req-2e854adc-44be-41f7-b50e-298732eef831 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:42.140023 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-7091e19d-c2df-4207-8914-0e3a7a4431c7 req-2e854adc-44be-41f7-b50e-298732eef831 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:42.140487 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [req-7091e19d-c2df-4207-8914-0e3a7a4431c7 req-2e854adc-44be-41f7-b50e-298732eef831 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:42.152201 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.compute.server_external_events [req-7091e19d-c2df-4207-8914-0e3a7a4431c7 req-2e854adc-44be-41f7-b50e-298732eef831 service nova] Creating event network-vif-deleted:48995f61-b1de-411b-9621-65e545d953f7 for instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 on hv-cinder-84989 Aug 05 15:43:42.157105 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [req-7091e19d-c2df-4207-8914-0e3a7a4431c7 req-2e854adc-44be-41f7-b50e-298732eef831 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031540 Aug 05 15:43:42.158110 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 543/1087] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:43:42.179118 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffd179bd4a445eaafb53d7accede863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e62e9372a7a47528e7973537bebbfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:43:42.187899 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-9fec5b7b-5d93-414f-a52c-4de068219099 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 200 len: 1513 microversion: 2.1 time: 0.110904 Aug 05 15:43:42.188543 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 545/1088] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:42 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 1513 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:43:43.210319 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:43.211023 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] [instance: 84f4ac26-5bea-44a0-9a56-8f33e3006c10] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:43.217589 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:43.218353 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:43.218523 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:43.219231 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:43.219680 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:43.220126 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:43.233784 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] HTTP exception thrown: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 could not be found. Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Request method failure captured: Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 HTTP/1.1 Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TotJgANiQSc_LiWRegVCj0e0k_oizT696a49-YGK1jZ4Hw9NCS8vFO49a0TI5q9djjSMhSsEt-n9kATJtLahP_NxyrVbbAeYVHMLHFmzhqFmsAU9M28y3qhHi7-kXRHHInkLOQzLZvJcIHX1GC1LEg69mezgOlu-k659Pkj89GqAE8 Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 6e62e9372a7a47528e7973537bebbfb6 Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-TestMinimumBasicScenario-1826098860 Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:43:43.235436 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e62e9372a7a47528e7973537bebbfb6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e62e9372a7a47528e7973537bebbfb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e62e9372a7a47528e7973537bebbfb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e62e9372a7a47528e7973537bebbfb6"}]}] Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-TestMinimumBasicScenario-1826098860 Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 6e62e9372a7a47528e7973537bebbfb6 Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1826098860 Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-TestMinimumBasicScenario-1826098860-project Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: 8ffd179bd4a445eaafb53d7accede863 Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-TestMinimumBasicScenario-1826098860-project Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 could not be found. Aug 05 15:43:43.237088 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': '84f4ac26-5bea-44a0-9a56-8f33e3006c10'} Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 could not be found. Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:43:43.238197 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 could not be found. Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 could not be found. Aug 05 15:43:43.239727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:43:43.241118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Returning 404 to user: Instance 84f4ac26-5bea-44a0-9a56-8f33e3006c10 could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:43:43.241118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-cf60695d-7fc5-4254-918e-031a4eeb1f24 tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10" status: 404 len: 111 microversion: 2.1 time: 0.031254 Aug 05 15:43:43.241118 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 544/1089] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:43:43 2022] GET /compute/v2.1/servers/84f4ac26-5bea-44a0-9a56-8f33e3006c10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:43:43.251161 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-eceb6c04-65bd-48c6-b6e2-31d29cb3504d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] Calling method '.version_select at 0x7fcb14d2f5e0>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:43.331873 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-eceb6c04-65bd-48c6-b6e2-31d29cb3504d tempest-TestMinimumBasicScenario-1826098860 tempest-TestMinimumBasicScenario-1826098860-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2052878287" status: 202 len: 0 microversion: 2.1 time: 0.086035 Aug 05 15:43:43.332487 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 546/1090] 10.222.0.40 () {58 vars in 1272 bytes} [Fri Aug 5 15:43:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2052878287 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:43:59.746724 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:43:59.747209 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:43:59.753559 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-e2c522b4-65a1-4fce-9152-3ff013dadfc6 req-956928c9-008f-40d6-a47e-d26b300973fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47d4294-a4d6-4950-b778-7e1947c6a8ef", "tag": "1b2ba23a-8013-4633-b805-dfe87929d3df"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:43:59.759213 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:59.759871 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG dbcounter [-] [118722] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:59.762765 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:59.763435 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG dbcounter [-] [118723] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=118723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 15:43:59.768858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:59.769500 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:59.769769 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:59.770691 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:59.770924 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e2c522b4-65a1-4fce-9152-3ff013dadfc6 req-956928c9-008f-40d6-a47e-d26b300973fa service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:43:59.771144 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:59.771598 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:59.772099 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e2c522b4-65a1-4fce-9152-3ff013dadfc6 req-956928c9-008f-40d6-a47e-d26b300973fa service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:43:59.772615 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-e2c522b4-65a1-4fce-9152-3ff013dadfc6 req-956928c9-008f-40d6-a47e-d26b300973fa service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:43:59.784945 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-e2c522b4-65a1-4fce-9152-3ff013dadfc6 req-956928c9-008f-40d6-a47e-d26b300973fa service nova] Creating event network-changed:1b2ba23a-8013-4633-b805-dfe87929d3df for instance c47d4294-a4d6-4950-b778-7e1947c6a8ef on hv-cinder-84989 Aug 05 15:43:59.790335 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-e2c522b4-65a1-4fce-9152-3ff013dadfc6 req-956928c9-008f-40d6-a47e-d26b300973fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040237 Aug 05 15:43:59.790937 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 547/1091] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:43:59.826526 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Going to try to terminate instance {{(pid=118722) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 15:44:00.091270 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-9afcc406-a5e9-4faa-9798-a601614ba877 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 204 len: 0 microversion: 2.1 time: 0.348314 Aug 05 15:44:00.092706 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 545/1092] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 15:43:59 2022] DELETE /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 15:44:00.101675 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:44:00.102348 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:44:00.114752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:00.114752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:00.114752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:00.114752 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:00.115149 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:00.115149 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:00.300994 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:44:00.308943 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-0d3dae12-73ff-4738-b740-86923e5794d9 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.212048 Aug 05 15:44:00.309529 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 548/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:44:00 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:44:01.332690 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:44:01.333394 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:44:01.340923 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:01.341403 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:01.341830 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:01.342511 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:01.342958 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:01.343376 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:01.479866 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:44:01.487670 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-5915062c-85c0-4409-9815-53c6268c9b7f tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1566 microversion: 2.1 time: 0.159898 Aug 05 15:44:01.488277 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 546/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:44:01 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:44:02.082273 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [req-02e7c011-95bf-44e8-8101-e572f963b379 req-300a0abd-7726-4b84-96ca-fa9586f0a551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47d4294-a4d6-4950-b778-7e1947c6a8ef", "name": "network-vif-deleted", "tag": "1b2ba23a-8013-4633-b805-dfe87929d3df"}]} {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 15:44:02.102329 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-02e7c011-95bf-44e8-8101-e572f963b379 req-300a0abd-7726-4b84-96ca-fa9586f0a551 service nova] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:02.102329 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-02e7c011-95bf-44e8-8101-e572f963b379 req-300a0abd-7726-4b84-96ca-fa9586f0a551 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:02.102329 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [req-02e7c011-95bf-44e8-8101-e572f963b379 req-300a0abd-7726-4b84-96ca-fa9586f0a551 service nova] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:02.106529 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.compute.server_external_events [req-02e7c011-95bf-44e8-8101-e572f963b379 req-300a0abd-7726-4b84-96ca-fa9586f0a551 service nova] Creating event network-vif-deleted:1b2ba23a-8013-4633-b805-dfe87929d3df for instance c47d4294-a4d6-4950-b778-7e1947c6a8ef on hv-cinder-84989 Aug 05 15:44:02.112176 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [req-02e7c011-95bf-44e8-8101-e572f963b379 req-300a0abd-7726-4b84-96ca-fa9586f0a551 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033488 Aug 05 15:44:02.112951 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 549/1095] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 15:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 15:44:02.511933 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:44:02.514205 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:44:02.522417 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:02.522728 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:02.523297 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:02.524094 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:02.524564 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:02.524983 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:02.590267 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.policy [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:44:02.598497 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-3d637e3f-20f8-45a9-b718-e6dcfd7642ae tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1218 microversion: 2.1 time: 0.092737 Aug 05 15:44:02.599055 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 547/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:44:02 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:44:03.619221 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:44:03.619927 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.compute.api [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118723) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:44:03.626531 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:03.627019 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:03.627475 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:03.628200 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:03.628654 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:03.629112 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:03.660353 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:03.660839 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:03.661275 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG oslo_concurrency.lockutils [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:03.661724 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.objects.instance [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lazy-loading 'fault' on Instance uuid c47d4294-a4d6-4950-b778-7e1947c6a8ef {{(pid=118723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 15:44:03.706566 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.policy [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a7a3b126294571a8586b6e7b43056c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3f679565d546ff8e6418643699c002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118723) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 15:44:03.714312 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-76b72588-83ec-4b96-9b96-a232448008e6 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 200 len: 1223 microversion: 2.1 time: 0.099297 Aug 05 15:44:03.714872 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 550/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:44:03 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 15:44:04.736343 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '>' {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:44:04.736963 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.compute.api [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] [instance: c47d4294-a4d6-4950-b778-7e1947c6a8ef] Fetching instance by UUID {{(pid=118722) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 15:44:04.743661 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:04.748915 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:04.748915 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:04.748915 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Acquiring lock "2afb463e-7116-427f-86ac-1e9017fa5c96" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 15:44:04.748915 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 15:44:04.749348 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG oslo_concurrency.lockutils [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Lock "2afb463e-7116-427f-86ac-1e9017fa5c96" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 15:44:04.761132 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.wsgi [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] HTTP exception thrown: Instance c47d4294-a4d6-4950-b778-7e1947c6a8ef could not be found. Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Request method failure captured: Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: request: GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef HTTP/1.1 Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept: application/json Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Accept-Encoding: identity Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Connection: close Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Length: 0 Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Content-Type: application/json Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Host: 10.222.0.40 Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Openstack-System-Scope: None Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: User-Agent: python-urllib3/1.26.11 Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Auth-Token: gAAAAABi7TmSUx3fT-fhJi_UfYMXpIsNZKZrkzzQZknKmz5QhWgRcwCv6M_mcW-iqONLSzJqHZ93L5moWpGKOS7CD9TsoXm5EGJBi68O9o6AFCCiZ0ofAqmZdlGKVA4vPu5BAu1j5lFiOzbPZSumbZyR7rG2NTZSSrl9rjBDg-oTuCG6tc67NEE Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Id: None Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Domain-Name: None Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Identity-Status: Confirmed Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Is-Admin-Project: True Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Id: default Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Domain-Name: Default Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Id: 7b3f679565d546ff8e6418643699c002 Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Project-Name: tempest-TestShelveInstance-457044803 Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Role: reader,member Aug 05 15:44:04.763089 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Roles: reader,member Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b3f679565d546ff8e6418643699c002", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b3f679565d546ff8e6418643699c002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b3f679565d546ff8e6418643699c002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b3f679565d546ff8e6418643699c002"}]}] Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant: tempest-TestShelveInstance-457044803 Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Id: 7b3f679565d546ff8e6418643699c002 Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-Tenant-Name: tempest-TestShelveInstance-457044803 Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User: tempest-TestShelveInstance-457044803-project Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Id: default Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Domain-Name: Default Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Id: f2a7a3b126294571a8586b6e7b43056c Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: X-User-Name: tempest-TestShelveInstance-457044803-project Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: method: > Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: exception: Instance c47d4294-a4d6-4950-b778-7e1947c6a8ef could not be found. Aug 05 15:44:04.764970 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: action_args: {'id': 'c47d4294-a4d6-4950-b778-7e1947c6a8ef'} Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: {{(pid=118722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47d4294-a4d6-4950-b778-7e1947c6a8ef could not be found. Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 15:44:04.766065 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47d4294-a4d6-4950-b778-7e1947c6a8ef could not be found. Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47d4294-a4d6-4950-b778-7e1947c6a8ef could not be found. Aug 05 15:44:04.767774 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: ERROR nova.api.openstack.wsgi Aug 05 15:44:04.770033 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: DEBUG nova.api.openstack.wsgi [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Returning 404 to user: Instance c47d4294-a4d6-4950-b778-7e1947c6a8ef could not be found. {{(pid=118722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 15:44:04.770875 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO nova.api.openstack.requestlog [None req-782f1740-d40b-4acf-8bd5-4a664fc75597 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef" status: 404 len: 111 microversion: 2.1 time: 0.039135 Aug 05 15:44:04.771428 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: [pid: 118722|app: 0|req: 548/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 15:44:04 2022] GET /compute/v2.1/servers/c47d4294-a4d6-4950-b778-7e1947c6a8ef => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 15:44:05.077094 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: DEBUG nova.api.openstack.wsgi [None req-fd69f710-3343-4a34-a7a7-7a4f08205ed8 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] Calling method '.version_select at 0x7fcb15053160>' {{(pid=118723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 15:44:05.189198 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO nova.api.openstack.requestlog [None req-fd69f710-3343-4a34-a7a7-7a4f08205ed8 tempest-TestShelveInstance-457044803 tempest-TestShelveInstance-457044803-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-618991783" status: 202 len: 0 microversion: 2.1 time: 0.116390 Aug 05 15:44:05.190713 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: [pid: 118723|app: 0|req: 551/1099] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 15:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-618991783 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 15:44:21.615760 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:44:21.616321 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Fri Aug 5 15:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:44:31.982085 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:44:31.982531 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Fri Aug 5 15:44:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:46:09.611787 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:46:09.612398 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Fri Aug 5 15:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:46:12.244229 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:46:12.244727 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Fri Aug 5 15:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:46:20.276005 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:46:20.276611 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Fri Aug 5 15:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:46:30.876858 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:46:30.877630 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Fri Aug 5 15:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:47:41.623562 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:47:41.624152 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Fri Aug 5 15:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:47:51.990180 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:47:51.990659 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Fri Aug 5 15:47:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:49:29.620032 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:49:29.620650 dv-cinder-849890-4-iscsi devstack@n-api.service[118723]: Fri Aug 5 15:49:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 15:49:32.252632 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 15:49:32.253696 dv-cinder-849890-4-iscsi devstack@n-api.service[118722]: Fri Aug 5 15:49:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!